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ABSTBACT 

This  lengthy  docuaent  describes  a  Career  Achieveaent 
Skills  Training  (CAST)  prograa,  iapleaented  in  Pontiac,  Hicbigan,  a 
highly  industrialized  city  of  120,000  located  approxiaately  30  ailes 
froB  Detroit.  The  purpose  of  the  prograa  was  to  deliver  career 
achieveaent  skills  to  selected  K*12  students.  Through  the  skill 
processes  presented  in  the  CAST  prograa  the  students  develop  skill^i 
needed  to  learn  about  and  plan  for  their  careers.  An  inservice 
training  prograa  was  first  held  for  teachers  *and  counselors  so  that 
they  would  understand  the  prograa.  Then  these  teachers,  using  a 
lesson  plan  aanual  developed  by  CAST  participants,  delivered  the 
prograa  to  their  students  once  per  week  over  the  course  of  the  year. 
This  particular  aanuscrlpt  describes  the  prograa  in  detail  and 
includes  a  section  on  aajr^r  findings  and  on  prograa  evaluation. 
(Author/BHV) 


Abstract 


ERIC 


The  focus  of  the  CAST  project  was  to  deliver  career  achievement  skills 
to  selected  K-12  students.    In  the  expe  iding  phase  the  students  learn  how  to 
expand  inforaation  about  themselves  and  the  job  by  using  people  and  thing 
sources.    Tha  narrowing  phase  helps  the  students  relate  the  career  information 
to  their  values  using  a  decision-making  process.    Finally,  in  the  preparing 
stage,  the  students  conduct  an  interview/internship  with  a  person  working  in 
the  job  they  have  chosen,  re-evaluate  their  job  decision  in  light  of  the 
information  gained  and  develop  a  program  to  bring  them  closer  to  Jrheir  career 
goal.    A  recycling  through  the  process  may  help  students  further  expand  career 
ini'ormation  or  it  may  help  them  expand  information  in  other  areas  of  their 
life.    The  process  must  be  used  to  be  maintained. 

Throu^  the  skill  process  presented  in  the  CAST  program  tfc*  students 
learn  the  skills  of  how  to  learn  about  and  r^.an  for  their  careers.  These 
skills  will  help  students  increase  their  career  and  life  choiceis.  CAST 
students  do  not  'lave  to  rely  on  chance  to  dictate  their  fates,  they  have 
skills  to  maxiirize  their  successes. 

The  program  was  implemented  in  Pontiac,  Michigan,  a  highly  industrialised 
city  of  120,00C  located  ^"n  Oakland  County  approximately  30  miles  north  of 
Detroit.    The  s^thool  district  includes  120,000  people  as  compared  with  almost 
700,000  people  ii  Oakland  County  and  7,800,000  in  the  State  of  Michigan.  Of 
the  120,000  people,  25%  are  Black  and  are  Latino.    Tlie  percentage  of  Black 

exceeds  the  percentage  of  both  the  state  and  county  level. 

Most  of  the  residents  of  Pontiac  are  employed  wi.th  one  of  the  three  r.ajor 
General  Motor  Divisions  located  within  the  city  limits.    However,  Ponti'^c, 
being  the  industrial  center  that  it  is,  does  not  provide  adequate  employment 
and/or  income  for  all  its  residents. 

Approximately  4^0  students  distributed,  as  shown  in  the  chart  below,  v;ere 
involved  in  Phase  III  of  the  CAST  program. 

Grade  Level  Tntal  f  of  Students  Receiving  CAST 

1  60 
7  210 

e.  150 

9  90 


TtiQse  students  represented  a  cross  section  of  the  Pontiac  Schools  which 
have  a  racial  balance  of  approximately  6051^  White,  30?^  Black  and  103S  Latino. 

In  order  to  insure  that  CAST  participants  could  develop,  deliver,  and 
disseminate  the  CAST  program,  training  was  necessary.    This  Phase  III  training 
was  conducted  for  selected  teachers  and  counselors  and  was  lead  by  Dr.  Ted 
Friel  and  Dr.  David  Berenson  from  Carkhuff  Associates.    They  were  assisted 
by  eight  Pontiac  trainers  who  had  been  involved  in  the  CAST  program  the 
previous  year  and  were  serving  as  trainer  interns. 

The  training  was  based  on  the  Carkhuff  Human  Resource  Development  Model. 
(Csrkliuff,  Qerenson,  Pierce  197^)  and  included  human,  educational  and  career 
skills.    The  slcills  were  presented  using  the  Working  Skills  and  Life  Skills 
Series  (Carkhuff  197-'+)  and  the  Phase  II  Lesson  Plan  Manual  developed  by  CAST 
participants. 

Using  the  above  lesson  plan  manual,  the  teachers  and  counselors  delivered 
the  procrar.1  and  revised  the  lesson  plan  manual  according  to  their  students* 
needs.    The  revisions  were  reviewed  and  a  Phase  III  Lesson  Plan  Manual  devel- 
oped.   V^iiile  the  Phase  II    manual  was  more  appropriate  for  delivery  of  CAST 
to  students,  tne  Fnase  ITI  manuaD.  was  more  suited  for  training  teachers  ajid 
counselors  to  deliver  to  CAST  skills. 

Tlie  teachers  and  counselors  delivered  CAST  once  per  week  over  the  course 
of  the  year. 

During-tivis  tin;e  the  trainers  provided  followup  observations  in  the 
classroom,  provided  programs  for  skill  im.-^rovement  and  conducted  evening 
training  session.'^.    In  addition,  the  trainers  helped  u-^ganize  internship 
for  each  student  in  the  CAST  program. 

Before  going  out  on  thcrr  internship  several  classes  piloted  a  com- 
puterized job  exploration  system  called  CAOS  (Computer  Assisted  Occupational 
Search)  which  was  modified  by  the  Pontiac  Research  and  Evaluation  Department 
and  on  Dr.  John  Holland's  "Self  Directed  Seari^h".    The  purpose  of  this  search 
was  to  provide  students  with  another  way  of  expanding  jobs  before  deciding  on 
their  internships. 

The  followinir  is  a  summary  of  the  instruments  used  to  evaluate  the  com- 
ponents of  the  Fnase  III. 

The  students  were  post  tested  using  an  open  ended  eumraary  question 
which  asked  them  to  develop  a  career  plan.    R'^sultss    CAST  students  significantly 
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outperformed  non  CAST  students. 

Teachers  and  counselors  were  evaluated  before  and  after  training  using 
human,  education  and  career  inventories  developed  by  Carkhuff  AsBociatee. 
Hesiilts:    Teachers  and  counselors  iiicreased  significantly  in  the  huraan  and 
education  skills* 

Teachers  and  counselors  responded  to  a  ques'  ionaire  addressing  all 
components  of  CAST, 

CADS  was  piloted  with  several  classes  and  compared  to  a  non  compu- 
terized version. 

The  re suite  of  the  evaluation  are  as  Follows: 
Students 

SLernentary  students  can  learn  the  career  achie^'ement  skills. 

CAST  junior  hi^h  students  significantly  outperformed  non  CAST  students 
in  devolopint;  a  career  plan. 

Hi^h  school  students  trained  in  the  CAST  skills  and  human  skills  stand 
a  90^i  greater  chance  of  being  hired  for  a  job  than  non  CAST  students. 

Training 

Teachers  and  counselors  trained  by  CAST  trainers  did  show  significant 
rains  in  the  human  and  educational  skills  from  pre  test  to  post  test. 

Curriculum  Dcvelopinent  and  Delivery 

Over  75Jo  of  the  teachers  felt  that  the  curriculum  was  better  than  the 
traditional  -atorials  in  terms  of  student  learning. 

Approximately  77?^  of  the  teachers  felt  that  th^  best  way  to  deliver 
CAST  vas  using  the  lesson  plan  manual  and  the^  comic  book  -  The  Story  of  Who 
(Carkhuff  197^)  together. 

CADS 

Students  using  CADS  can  complete  the  instrument  in  one-fourth  the 
time  that  students  using  the  non  computerized  version  of  Dr.  John  Holland's 
"Self-Directed  Search". 

CAST  was  an  outstanding  project  which  can  serve  as  a  model  career 
education  delivery  system  for  other  school  districts  so  that  their  students 
can  be  equipped  with  the  skills  to  exorcise  their  freedom  to  live,  learn 
and  work  effectively. 
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This  first  major  section  includes  the  following  subsections: 

A.  Backcround  Information  -  This  is  included  to  provide 
the  reader  with  pertinent  data  regarding  the  comnmnity 
and  school  district  in  which  the  Human  and  Computer 
Assisted  Career  Achievement  Skills  Pi.gran  was  de^-el- 
oped  a-^  well  as  the  factors  which  influenced  and  the 
rationale  behind  its  development. 

B.  Riase  I  and  II  Prorrom  Description  -  This  will  provide 
the  reader  with  a  brief  overview  of  the  program  up 
until  the  beginning  of  Phase  III.    An  understanding  of 
the  ^irst  and  second  phases  will  assist  the  reader  in 
see inn  the  Phase  III  report  in  its  relation  to  the  first 
two  phases  of  the  project. 

C.  Phase  III  Introduction  -  In  this  subsection  the  goals 
of  Phase  III  will  be  discussed. 

D.  Hiase  III  Components  -  In  this  subsection  the  people, 
procrams  (training,  curriculum,  internship,  and  computer) 
and  organization  in  Phase  III  of  the  Human  and  Computer 
Assisted  Guidance  Program  will  be  described. 
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Locale 


Papttlation  -  Citr 


Pontine,  Nlemsaa  U  a  hi|^  industriaXistd  eity  of  120«000  loeattd 
in  Oakland  County  i^proxiMLtoly  30  MiXoa  nortli  of  I>ttroit»   Tho  aebool  4ia- 
trict  includoa  120,000  ptoplt  aa  coaparad  tilth  al«oat  700,000  ptopla  in 
Oakland  County  and  7,800,000  in  tho  Stmtt  of  Michigan.   Of  tho  120,000 
pooplo,  SSJt  art  black  and  4.^  aro  latino.   Oio  poroontaco  of  BUek  az- 
cooda  tho  poretntago  of  both  tho  atato  and  county  lo^ol.^ 


Moat  of  tho  rosidonta  of  Pontine  ara  a^ployod  with  ono  of  tha  throo 
■ajor  Ganoral  Motor  Diviaiona  locatod  vithin  tho  city  liaita*  Bovtror, 
Pontine,  baing  tho  indnatrial  eontor  thnt  it  ia,  dooa  not  provido  ado^to 
•■ployaont  and/or  ineoao  for  all  ita  roaidtnta.   A  look  at  tho  mabor  and 
••ount  of  SSSA  Titlo  I  and  GEO  prosrsM  ahowa  thnt  tho  porcontngo  of  toon- 
oaically  dopriTod  poraona  in  Pontine  txeooda  tho  atato  and  eounty  lorol. 

Tho  following  1970  conaua  infos«ntioa  illuatmtoa  thnt  tho  gonoral 
coapoaition  of  urban  contora  acroaa  tho  antion  in  in  ovidonco  in  Pontine. 

n*   Animnl  nonn  incoao  -  :^9,68o.0O 

b.   Annunl  incoao  by    of  faailioa  and  individualn 


Baployitnt 


Loan  than  tlOOO  2.559< 

flOOO  -  11999  2*72 

12000  -  12999  k.O^ 

13000  -  13999  'fr.lfi 


CoapamtiYo  Dntn  for  13  Niehignn  Motropolitnn  Coro 


Citioa  rankn  Pontine  fimt  in  unoaploynont  nnd  nt 


l(M  under  tho  poverty  IotoI. 


AOC  enaon  in  Onklnnd  County  Ciiniiiltion; 

ADC  Cnnoa 
Wo.      %  Co.  Total 


ADC  Children 
Wo.     %  Co.  gptnl 


Onklnnd  County  8,^9*/  100.00 
Pontine  3,869  '»?.33 


20,8U  100*00 
9,283  Mf.6l 


'All  ntntiatien  pronontod  nro  1970  eonnnn  figuron* 
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School  District 


Vhtn  tht  &tMii  and  Conputtr  AMiattd  Okiidane*  Progi^  b^u  la  1970, 
th«  tnroUMMt*  for  tho  Poatiae  Sekools  w«r«  aa  followa: 


Total  Student 

Total 

White 

Grade 

Snrollment 

White  Percent 

K-6 

1^.295 

8,986 

65.6 

7t9 

5,295 

5,550 

62.9 

1012 

6^ 

TOTAL 

23,977 

1^,977 

62,9 

Number  of 

Number  of 

Classroom 

Levi 

Schools 

Teachers 

K-6 

29 

^59 

8 

375 

TOTAL 

57 

85^^ 

Total 
Black 


Black 
Percent 

52.5 
52.8 
33.2 
52.7 


Number  of 
Counselors 

2 

51 


Number  of 
Pupils 

1^,295 
25,807 


S.A. 

Percent 

^f.5 
hi 


With  the  begianias  of  baaing  tha  acbool  organ! tsation  changed.  Half  of 
the  elMeataxy  achoola  becMt  K-5  and  tha  other  half  K,  Two  Junior 

Bigha  beoaaa  7th,  tvo  8th  and  two  9th  grade  achoola.   In  thia  organiaatioa 
oaa  early  eltaentary,  one  upper  alisentary  and  one  junior  hi|^  baeaia  a 
elaatar.   The  acheol  diatriet  haa  continued  to  operate  tindar  thia  integra- 
tion plan. 
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Special  FactorB 

Many  factors  locally,  nationally  and  at  the  state  level  laid  the  base 
for  the  development  of  the  Hunan  and  Computer  Assisted  Guidance  Program 
(H.C.A»G.P.)  in  Pontiac.   The  major  factors  which  contributed  to  Pontiac»s 
receiving  the  research  grant  are  discussed  below- 

Needs  Assesanent 

Preparing  Pontiac  students  for  the  world  of  work  has  been  a  joint 
effort  between  General  Motors,  the  elected  Board  of  Education  members  and 
public  school  officials.    However,  it  has  been  recognized  that  this  effort 
has  tended  to  limit  the  scope  of  career  exposure  and  preparation  to  the 
industrial  area*    During  the  past  few  years,  several  programs  at  the  ele- 
njentary  and  junior  high  levels  have  been  developed  in  an  attempt  to  broad- 
en student  exposure  and  prep8a*ation  for  career  opportunities.    Although  a 
start,  the  programs  were  reaching  very  few  students. 

Historical  Background 

The  Board  of  Education  members  and  the  Superintendent  of  Schools  real- 
ized that  a  couple  of  isolated  programs  were  not  enough.    In  response  to  the 
need  for  moro  programs,  they  made  the  development  of  career  preparation  pro- 
grams ft  high  priority  in  1970-71.    The  timing  was  perfect.    The  school  dis- 
trict was  preparing  to  implement  a  comprehensive  integration  plan,  which 
would  call  for  a  total  reorganization  of  the  school  district  in  September 
1971.    The  Board  membars  and  school  officials  saw  this  reorganization  as  w 
good  opportunity  to  concurrently  reorganize  the  ongoing  curriculum  to  in- 
clude career  preparation  programs. 

Also,  in  the  1970-71  school  year,  Pontiac  was  selected  by  the  U.S,  Office 
of  Education  to  develop  a  school  based  Comprehensive  Career  Education  Model 
(CCEM).    The  school  based  CCEM  was  one  of  four  models  being  initiated  and 
supported  by  the  U.S.  Office  of  Education.    The  CCEM  was  a  systematic  effort 
to  design  and  implement  a  new  educational  strategy  that  would  ensure  that  upon 
leaving  school,  students  would  be  prepared  for  career  pursuits  whether  it  in- 
volved direct  employment  or  continuing  education.    The  CCEM  sought  to  restruct- 
ure curriculum  in  terras  of  knowledge  of  career  and  human  development.  Because 
basic  attitudes  and  competencies  begin  to  develop  at  an  early  age  and  are  modi- 
fied over  time I  use  of  the  model  eracompassed  all  grade  levels. 

12 


Coacarrt&tly,  th«  Michigan  Vceatioaal  B*ie«tioa  Stpartstnt  vm  iatertst^d 
ia  Aiading  a  prejtct  vhidi  ifoold  fttrtlMr  d«T«lap  tk*  SCB8  (Sdaeatioaal  aad 
Cara«r  Cosputtr-Basad  daidaaea  S^ataa)  idiieh  had  baaa  dartlopad  ^  tha  M- 
vaiietd  ]>tTaIopaaat  Diviaioa  of  Intaxnatiaaal  Be^saaa  Naehiaaa  aad  fiaXd 
ttatad  in  Oanaaaaa  County*  Niehism*   Tha  Stata  waa  iatartatad  ia  dttaxaiaias 
if  SCXS  could  bo  aodifiad  to  aupport  tha  couaaolor  and  toachor  functions  within 
CCBI  or  Qould  bo  f^rthor  davoXopod  into  a  aoparato  tranapertahlo  otoaatioaal 
iaaovatioa  for  aao  ia  othok-  Niehisan  aehoola*   Tha  goal  waa  to  dotoxalno  a 
aohool  diatriet  idiich  could  atiliao  coBputor  toehaolofir  in  daralopiag  a  pro* 
grvi  which  would  aaaiat  couaaolora  anVor  toaehora  in  of footiTolj  aad  offi- 
cioatly  proparing  atudonta  for  thoir  oaroor  choieoa  aad  plana*    Bsntiae  waa 
aoloctod  aa  tho  aito  for  dorolopiag  aueh  a  project • 
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Phase 


Ob.iectives 

Hi*  project  was  first  titltd  th*  CoBprthtMiTt  Carter  Edaeatloa  Nodal  - 
Ceapatar  Aaaiatad  Ghiidaaea  Pregras  (CCBf-CASP>«   Sia  follewios  objaotiYaa 
¥ara  addraaaad  daring  tht  tirat  phaaa  af  tha  projact  -  Fabniarj  I  throu^ 
Aiighat  51,  X972: 

1*  To  tatabliah  a  eora  ataff  and  aapportivt  aarrioaa 
to  eoadaet  tha  asploratioa  aad  avalaatioft  of  cq«- 
pater  aaaiattd  gaida&ea. 

2m   Ho  azpXora  and  avaluata  tha  praaaat  ICXS  Progri  to 
datexvina  ita  f taaibility  for  iaplaaantation  in 
Oaklaad  Cotantj. 

3«    To  int«grata  c  atudant  racord  packagt  jito  tha  total 
coaputar  aaaiattd  gaidaact  prograa. 

4«    To  dtaign  an  inatnriea  training  prograa  for  all  Bon- 
tiac  cotiaaalora  and  aaltcttd  ttaehara  thctt  vill  up- 
^rada  tha  quality  and  tffieitncy  of  eonnatling 
throoit^  coMpntar-ralattd  akiUa* 

3*   To  dartlop  an  avaluatioa  daaiga  for  all  aapacta  of 
Fhaaa  ZI« 


Rocotnr.endn  t  ion-  • 

Vtilisiag  local,  oeaatj  and  conaaltaat  ptraoaaal,  to  aetoapliah  tha 
obJaetlTta  abora,  tha  foUoving  rtooflatadatiaas  vtrt  aadat 

1*    DtTtlopaaat  of  the  progrw  eoneapt  r^^aaatad  Igr  tha 
ECE5  ayllatea  ooaponant  (idiich  dalivtra  earttr  daeiaien- 
aakiag  akiUa  to  stadaata)  to  iacladt  earatr  adUavtatnt 
akill  dtliTtry  \<ould  providt  a  aatdad  eoapoaant  to  GCBf, 
ia  ftaaiblt,  aad  ia  rteooBtndtd.    (fhaaa  I,  Objaetira  2.) 

2.    Tha  buaan  rtlationa  dtvtlopatat  akill  training  eo«poaant 
of  SCSS  waa.  found  rtltvant  to  CdM  nttda«  la  ftasibla  for 
conaaalora  and  ttadia'M,  ia  naeaaaazy  to  tht  dtralopatnt 
of  earttr  aohiaTMant  akill  pregraaa  for  atadantst  and  ia 
rtcaaatadtd«>    (Phaat  I,  ObJtetiYta  2  and  km) 

3*   Modifiieatioa  of  tha  coaputtr  atadtnt  iattractioaal  cob* 
pontnt  of  BCS3  to  attt  CCBI  objtotivta  dirtotljr  waa  not 
faaaiblt  bteaiiaa  of  tha  laajor  ehaagaa  rt^irtd  aad  tha 
axpanaa  of  Making  theaa  duogaa.   laaoa,  aaoh  aodifloatiaa 
ia  not  rtcooBtadtd* 


?Fhaaa  I  Baport  •  Brribtd  Projaet  ia  Vocational  Sdaaatioa  (Battenschlae-1972) 
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However,  certain  Mpects  of  the  computerised  stadeat  inter- 
actional  ECSS  coapoaent  ai^er  to  have  potential  in  aupport 
of  the  huMA  and  prograaatie  approches  to  deliveiy  of  carear 
achiereaent  akilla  aentioaed  in  paragrapha  1  and  2  above. 
Continued  analysis  of  SUES  for  Modification  aa  a  ceatputer 
cisisted  ogrstea  aiding  in  career  aehiev«aeat  akilX  aeqniai- 
t:.on  ia  recoaaended*    (liliaae  I*  Objective  2«) 

3*   The  KSS  student  record  subaystea  was  found  of  potential 
value  to  the  developoent  of  a  student  record  package  iMch 
would  be  part  of  an  overall  computer  sjatMi  auf^rting 
guidance,  plaecaent,  instructional ^.  and  adainiatrative  ac- 
tivities.  However,  the  basic  student  record  package,  under 
fonaaiation  elaewhere  in  Oakland  County,  was  found  to  be  in 
an  early  developaeat  stage  and  partially  dafined*   In  view 
of  the  taatativanesB  of  the  basis  package  definition,  ftirther 
aaalyaia  and  developaent  of  the  fiCSS  student  record  eoaponent 
are  not  recoaaended.  (Ihase  I,  Objective 


In  brief,  the  recoaaendationa  eaphaaise  Career  Achieveaent  Skills  pro- 
graa  developaent,  appropriate  huaan  and  technical  skilla  training,  and  con- 
tinued developaent  of  BCES  and  other  ocaputer  applicationa  in  support  of  the 
ileliverv  of  Career  Achiev«aent  3killa  to  atudenta. 
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BEST  copy  MAILABLE 

Reconunendations 

Prograin 

1.  fh«  CAST  obj«otlTM  ■teold  ¥•  sinyUfitd. 

2.  Tk«  CAST  enrriciilar  aad  lactxveiiOBal  proffraM  ihoald  h9  d«T«li(>p«d 
iBte  a  aodtX  ItMom  plaa  to  b«  iim«  at  tha  •I«rataxy,  j«aior  hlfli 
•Bd  Maior  lUgh  ltT«ls* 

3-   CoBtroI  groups  ahoald  W  •llttiaattd. 

Hm  cast  proffTfli  ikoiald  Im  dtliT«r«d  ovt r  th«  eanrM  of  tKko  yoor* 
5*   iBplMolo  ahoold  bo  on  latofntlai  CAST  wltb  othor  okillo.. 

Evaluation 

1.  Tbo  tootias  laatxuBoat  thoeld  bo  rovrittoa  baaod  oa  tho  aodol  carrie- 
ttlaa  to  bo  doaigaod. 

2.  9m  aiteiaiatratloa  and  acoriag  pxocodaro  ahoold  bo  roviaod* 

People 

1.  Tho  proaoat  CAST  partieipaata  oboald  bo  uaod  la  dif f o:.*oat  e^ifiitioa 
aoact  yoar. 

2.  Now  CAST  partieipaata  ahottld  bo  aoXootod  aad  traiaod  oaiag  loeal 
traiaora  aad  t)io  aow  currioilna* 

Computer 

1.   Tbo  eaipator  aheold  bo  caatianod  for  profm  aoaitoriaf • 
2*   A  eoaputorittod  Oeeupatioaal  lafaiwitioa  Botrioral  Sjwtm  ahoald  bo 
dOTolopod* 

3*   Hio  atttatpt  to  coapatoriao  tho  earrieuln  fihoald  ooaao  aatil  tho 
ettrrioaltiB  io  aoro  voll  dofiaod. 
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Phase  III 


Ob.^ectives 

la  wMariBiii^^  tht  Vham*  11  •bjtctlTM,  it  on      said  that  tb«  foctia 
in  Rum*  ni  «m  on  th»  disMoiaatiea  4f  tralaias  usiag  loe«X  tralMr*  in  tk* 
pilotiag  and  fterth«r  d«T«lopMat  of  ourriottliia  aad  th*  factraslom  of  oospitor 
cjjiplioatioiis.   Ibo  folloidas  aro  tho  Hum  III  objootiTts: 

1.  Qbo  haitdrod-twtiity-fiTo  olMataxy,  TOO  jvaior  tOfh  aad  200 
•chool  oimdonto  will  dMoaotrato  knovlodgo  of  eartor  aehiovtaaat 
akiUa  atotaaax7  for  oarMr  i»Ue«Miit  dorias  tha  1973-7^  aokool  yaar. 

2.  Iba  1973-7^  traiataa  viU  d«aoaatrata  kaowltdgo  of  istarforaoaal 
akiUa,  adueational  akiUa  aad  oaraar  akiUa  ateaaaaxy  to  dalivar 
tba  CAST  prograi  durins  tJf  197>7^  aohaol  jaar* 

3.  Iha  1972-73  traiaaaa  will  dMoaatrata  kaovltdga  of  adacatieaal  akiUa 
uaad  for  daliTozy  of  tha  aodal  laaaoa  plan  to  atadoata  dariag  tlia 
achool  jaar. 

k,   Thraa  altaaatazy  eaaaaalora,  oaa  juaior  hi^  conaaaler,  oaa  jaaior 
hi^  ttachar,  two  aaaior  hi^  eeaaaalora  aad  two  adBiaiatrmtora  will 
coadact  traia  ias  aad  follew-ttp  aaaaiaaa  ia  iatarparaaaal  akiUa* 
adaoatioaal  aUUa  aad  earaar  akilla  to  aaw  GASt  partieipaata  dariag 
tha  aumr  aad  tiM  1973-7'^  aelMOl  jaar. 

3.   Om  coapatar  will  !m  aaad  to  aaaljraa  earaar  aohiavtaaat  akilla  taat 
raaolta  dariag  tka  1973-7^  achool  yaar* 

6,   Saeeadazy  CAST  atadaata  duriag  tha  1973-7'^  aeheol  yaar  wiU  aaa  a 
Caspatar  Aaaiatad  Oeeapatieaal  Saasch  «yat«i  haaad  oa  Z)r«  John 
Bollaad'a  **Salf-Oiraetad  Stareh"*  (Holland  1970) 
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People 


Students  - 

The  teachers  in  the  CAST  program  were  asked  to  select  one  of  their 
classes  at  random  to  receive  the  CAST  instruction*    These  classes  repre> 
sented  a  heterogeneous  group  of  students.    The  table  below  summarizes  the 
breakdown  of  classes  by  numbers  of  students  and  grade  level. 


Grade  Level  Total  #  of  Students  Receiving  CAST 
1  60 

7  ao 

8  150 

9  90 

12  30 


The  purpose  of  the  CAST  instruction  was  to  deliver  the  following 
skills  to  students: 

Goals  of  Curriculum 

1.0   Expanding  job  titles  to  choose  from  using  the  interrolgative 
WHAT  and  WHO. 

2.0   Expanding  and  classifying  jobs  under  headings  of  people  or  things 

on  the  basis  of  what  people  do. 
J.O   Expanding  and  classifying  jobs  by  interest  areas  for  both  people 

and  thing  jobs. 

^.0   Expanding  job  awareness  by  classifying  jobs  in  one  or  more  of 

eight  interest  areas  according  to  educational  levels. 
5.0   Choosing  a  limited  set  of  occupations  to  explore. 
6.0   Developing  awareness  of  job  information  sources. 
7.0   Developing  and  using  questions  to  obtain  information  about  jobs. 
8.0   Clarifying  and  identifying  occupational  values  physical ♦  intellectual 

and  emotional  (What's  important  to  me). 
9.0   Ordering  of  occupational  values. 
10.0   Evaluating  job  based  on  personal  occupational  values. 
11.0    Identifying  specific  skills  through  personal  interview. 
12.0   Evaluating  oneself  in  relation  to  the  job  requirements. 
13.0   Developing  and  carrying  out  programs  for  acquiring  needed  occupation- 
al skills. 
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lk*0    Investigating  principles  that  relate  performance  te  goals  to 

human  benefit. 
15.0   Beevaluating  job  with  regard  to  new  information. 
16,0   Reevaluating  occupation  with  regard  to  change  of  values. 
17.0    Investigating  job  with  regard  to  pronx>tional  possibilities. 

As  a  result  of  learning  these  skills,  students  have  systematic  pro- 
cess for  increasing  their  alternatives  in  life  in  relationship  to  their 
values.    This  process  allows  them  to  expand  their  freedom  to  choose .as 
well  as  to  act    on  their  choices. 


Personnel 


The  diagram  below  illustrates  the  roles  and  relationships  between  vari- 
ous personnel  in  the  CAST  Delivery  and  Support  System.    The  delivery  system 
is  composed  of  those  people  having  responsibility  directly  affecting  the 
delivery  of  the  Career  Achievement  Skills  to  students*    The  support  system  is 
made  up  of  those  people  who  assist  the  "deliverers"  by  providing  informationi 
materials  and/or  people  services  which  facilitate  the  delivery  uf  the  program^ 
Each  role  and  relationship  will  be  described  separately. 


Project  Director 


Be search  &  Development 
External  Evaluator 


1972-73  Counselors 


I  Carkhuff  Associates t  Inc. 


Trainers 


Teachers  1973-7^ 


Students 


Support  System  * 


Delivery  System  * 


Delivery  System 

Teachers 

This  year's  group  of  forty  CAST  teachers  were  selected  on  the  same 
basis  as  last  year's.    (See  "Training  Components"  section  of  this  report 
for  a  description.) 

Thoir  primary  responsibilities: 

1)  to  be  trained  in  a  two-week  workshop, 

2)  to  deliver,  once  a  week,  the  Phase  II  Lesson  Plan  Manual 

3)  to  participate  in  monthly  class  meetings  for  followup  training, 
h)    to  be  observed  by  a  trainer  and  participate  in  feedback  meet- 
ings on  the  average  of  once  every  three  to  four  weeks,  and 

5)    to  make  modifications  in  the  curriculum  and  incorporate  their 
own  teaching  strategies  where  appropriate.    (The  strategies 
were  included  in  the  Phase  II  Lesson  Plan  Manuel*)  (See 
Appendix  B) 
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•    Caricnuff  Assoc is^tos  Delivery  and  Support  Systems  Model 


Of  the  forty  people  who  were  originally  selected,  not  all  were  able 
to  start  or  complete  the  program.    Approximately  fifteen  were  not  able  to 
participate  in  the  summer  workshop  due  to  changes  in  plans  which  occured 
between  June  and  the  third  week  in  August  when  training  began.    Some  who 
started  training  were  unable  to  complete  training  because  of  moving  out  of 
tb?  district.    Of  the  others,  two  dropped  out  during  the  year  because  of  the 
time  involved  in  delivering  the  program  which  they  felt  prevented  students 
from  learning  skills  in  their  regular  content  area.    Finally,  two  others  were 
x;nable  to  deliver  the  program  because  of  scheduling  problems  within  their 
school . 

Trainers 

Of  ten  CAST  trainers  seven  were  counselors,  one, a  teacher  and  two  admin- 
istrators.   All  met  the  following  criteria: 

1)  mastered  the  human,  educational  and  career  inservice  skills 
necessary  to  deliver  CAST,  (See  description  under  "Training 
Conponents"  section  in  the  PROGRAM  DESCRIPTIDN  SECTION) 

2)  had  delivered' CAST  the  previous  year  and 

3)  were  free  to  train  and  observe  the  1973-7'*  CAST  teachers. 
The  CAST  trainerrf  major  responsibility  was  to  deliver  skills  and  pro- 
grams to  CAST  teachers.    The  trainers'  variety  of  activities  included  the 
follov/ing: 

1)  to  participate  as  trainer-interns  for  three  days  learning 
training  skills, 

2)  to  inservice  trainees  in  human,  educational  and  career  skills 
in  a  two-week  workshop, 

3)  to  make  weekly  and  monthly  observations  of  CAST  teachers, 
k)    to  set  up  monthly  feedback  sessions  with  CAST  teachers, 

5)  to  conuuct  montiily  CAST  training  meetings, 

6)  to  attend  monthly  training  meetings  with  a  member  of  Carkhuff 
Associates, 

7)  to  attend  weekly  CAST  ti'ainer  planning  meetings, 

6)    to  coordinate  internships  within  their  building,  and 
9)    to  develop  training  material  as  needed. 
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Curkhuff  Associates 

Two  members  of  Carkhuf f  Associates  served  as  consultan  3  and  master 
trainerf;  for  the  CAST  projects    (See  Appendix  F  for  their  contract  and 
see  •'Consxiltant  Report"  in  Appendix  V  for  their  final  report.    Dr*  Ted  Friel 
v/orked  with  the  trainers  and  teachers  in  human  and  career  skills  during 
the  sir.mer  inr^ervice  training.    Dr.  Friel  and  the  Project  Director  were 
recponcible  for  the  development  of  the  career  assessment  instrument. 
Dr.  David  Berenson  had  responsibility  for  the  educational  part  of  the 
sunr.er  traininc  and  for  the  development  of  the  teacher  observsition  instru- 
ment.   He  also  trained  the  trainers  monthly  in  classroom  observation! 
teacher  diapnosis,  -oal  setting  and  program  development  skills.    His  major 
renponsibilities  were: 

1)  to  support  the  trainers  so  that  they  could  take  primary 
responsibility  in  delivering  the  human,  educational  and 
career  skills  and  in  conducting  follow-up  training  with  . 
the  teacher, 

2)  to  advise  the  Project  Director  as  to  content  and/or  opera- 
tional problem  areas,  and 

5)    to  develop  programs  in  response  to  these  problems* 

Support  System 

1972-73  CAST  Counselors 

T!xe  five  counselors  (who  were  not  trainers)  who  were  in  the  pjrogram 
last  year  could  not  be  freed  to  deliver  the  CAST  program  because  of  other 
responsibilities.    Ho\^;ever,  several  supported  the  CAST  teachers  in  their 
buildin^;?^  by  providing  career  information,  setting  up  role  models  and  co- 
ordinating internships. 

Research  and  Development 

Tae  project  required  half-time  services  from  Mr.  Al  Pavlish,  Assistant 
Director  of  the  Pontiac  Research  and  Development  Department.  Mr.  Pavlish^s 
responsibilities  were; 

1)  to  develop  the  occupational  information  retrieval  system, 

2)  to  analyse  all  CAST  data 

3)  to  consult  with  the  project  director  on  research  questions 
and  procedures,  amd 

h)    to  monitor  the  evaluation  process. 

5)    to  write  the  CAST  Evaluation  Report  (See  PROGRAM  EVALUATION  SECTION) 
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External  Evaluntor 

The  external  evaluation »  Dr#  Theodore  Ploughman,  had  as  his  primary  function 
that  of  auditing  and  verifying  all  data  collected  by  the  Pontiac  Research  Develop- 
ment Department  as  well  as  Carkhuff  Associates*    (See  Appendix  E  for  his  contract 
and  ••External  Bvaluator's  Report ••  in  Appendix  U* 

Project  Director 

The  Rroject  Director  had  the  following  responsibilities: 

1*    Defining  project  policies  and  procedures. 

?•    Monitoring  the  training  component,  curriculum  development 

and  delivery  component  and  the  evaluation  component  of  the  project • 

3*    Developing  the  research  design^ 

Developing  the  teacher  and  student  assessment  and  evaluation 
instruments  with  assistance  from  the  Carkhuff  consultants* 

CoriClu!^ionn 

Using  the  Cnr>vh^2^''  delivery  and  5?upport  nystons  model  helped  to  define 
nvA  cxorcviho  CAST  porticip.antn  roles  and  relationships  in  ternis  of  student 
outco:^er«    I*,  wa?  evtrcrr.ely  realiable  to  the  Project  Director  in  planning, 
org:tni:::inc,  anc3  irnpli.^enting  tanks*    In  addition  it  provided  a  visual  schema 
of  co.jT.unicating  rclationsV.ips  and  resi^onsibilities  to  others* 
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Training  Component 

In  order  to  insure  that  all  members  of  the  delivery  systen:  had  the  skills 
noc  rear^-  t>^  t-ench  ctuContCi  training  wa55  necessary. 

TtiQ  followin;?  paf^s  will  explain  the  purpose  and  the  component  of  the 
Career  Achievcn-ent  Skills  Training  which  are  listed  below: 
1 )    Selection  of  Participants 
r)  Prc^nration 
7;)    Trnininj  Procedure 
'0    Teac!:er  Obrervation 
r  )    Pollov;-up  Training 
^)    Trainer  Observation  Training 
^)    Materials  and 

Hocourrjondations  for  future  training. 

Ar.  initial  tvo-vook  nunmer  training;  was  conducted  from  8:00  -  5:00  p.m. 
for  apprnxinately  p^.  selected  teachers  and  counselors  who  were  paid  and  rec^iived 
unive-s^ty  crodit  fcr  their  participation.    This  ii.itial  training  v;as  led  by 
Dr.  Ter.  Friel  and  Dr.  David  3erenson  and  eight  Pontiac  trainers  *'^»o  had  been  in 
the  CAST  profra-n  the  previous  year  and  were  serving  as  trainer  interns.  Follow- 
ing the  cvufiiner  training  the  Pontiac  trainers  assumed  responsibility  for  all 
follow* up  observations  and  training. 
PurpoGO  of  Trr.inlr\{^  - 

Cnc  of  the  purpocoo  of  the  CA£T  training  v/as  to  insure  that  CAST  teachers 
and  counnclors  could  fii\ct  do  the  skills  they  were  teaching  their  students.  A 
r^ocond  purpore  vr:r.  to  give  to  the  teachers  and  counselors  the  skills  they  needed 
to  furtV.or  'develop  nnd  acliver  the  CAST  program.    Another  purpose  was  the  develop^ 
ment  of  trainers  v;ho  could  continue  the  dissemination  of  the  skills  to  othors# 

Tain  training  in  bnsed  on  Dr.  Carkliaff^s  philosophy  that  the  effectiveness^ 
•jf  n  p^'og.'nr  ir  n  f':nctlun       the  skill?       the  people  training,  those  dclivr^ring 
rhc  projrr:..  to  irtudonts,  a.-^  '/ell  us  the  effectiveness  of  the  programs  developed* 
So  to  inuure  the  highest  level  of  delivery  and  development  in  the  CAST  prograrn  - 
tr-irning  v;ac  "csonti.-a. 

Contv^nt  of  Hvrij^Ar.F. 

Huriian  Skills 

Hr*^}-es.»r.tat\vcG  from  Carkliuff  Asrociates,  assisted  by  the  Pontiac  trainers, 
ci^'ic'uctOiJ  an  i\r.orvicc  v/'^rkcliop  w'nich  delivered  human  skills,  such  as:  attending, 
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respondini:  and  initiatinc*    These  skills  are  verbal  and  non-verbal  communication 
skills  v;hicli  allowed  a  •^helper^*  to  explore  and  comraxmicate  to  the  •*helpeo'*  where 
he  ist  where  ho  waatn  to  go»  and  how  to  help  him  get  there#    In  addition^  the 
"helper"  u.«?c3  problem  solving  or  decision-making  skills  to  help  the  ^^helpee" 
understand  what  alternative  courses  of  action  are  open  to  him  and  to  have  him 
decide  what  alternative  is  best  for  him.    The  "helper"  uses  action  skills  to 
help  the  "helpee"  develop  a  program  which  can  help  him  act  on  his  under standinc 
and  move  hicr.  from  where  he  is  to  where  he  wants  or  needs  to  be*    (The  above 
skills  are  found  in  the  books  The  Art  of  Helping  (Carkhuff  1972)  a.id  The  krt  of 
Problem  Solvinr  (Carkhuff  197^). 

Sducation  Skills 

Al:30,  the  v/orkshop  addressed  the  education  skills  of  diagnosingt  goal 
ectti       proi^ran  (curriculum)  development i  teaching  methodSf  leeurninc  strate^ues 
ni:t^  cla;:;55rcor.     nacerr.cn'..    The  first  three  skills  help  a  teacher  and  counselor 
'^s^Dvr-L  l!.  vhich  fkHI  aro*^^  related  to  the  subject  raatteri  the  student  is  having 
probliMr.c*    Tin  no  rkills  then  rHow  the  teacher  and  counselor  to  determine  a 
;.70cil  Tor  th^t  rwU(>/nt  nm]  then  to  develop  a  step  by  step  program  by  which 
tlae  rlUiij/.t  can  ros^ch  the  ^^oal>    The  teacher  and  counselor  then  selects  their 
t'.-aching  :rictho.'3s  a:A  ntrritocioc  to  reflect  the  skill  beinc  taught  and  the  learn- 
ing ntyle       t-:o  .rtudont.    Clissroon  .-nanacencnt  techniques  ore  used  to  differ- 
entially roin^'o)  -: :  otuduMit  per ror:iancc.  (These  skills  are  introduced  in  The 
A.-t  of  T-acrhit,/:  (Carld/arf,  Bc'ronson*  Pierce  197'*) 

Career  Skills 

Finally^  t!:r  works'aop  fuJdrossed  the  Career  Achievement  Skills  of  expand- 
in^;,  nrxrrot^inr  an'^  action.    The  tyiree  Career  Achievement  Skills  deal  primarily 
with  helpinr  ntuc^ents  expand  information  about  themselves  and  jobsi  giving  them 
a  way  to  decide  amonn  alternative  choices  and  then  providing  them  the  skills  to 
nrepnre  for  thnir  choice.    (These  skills  are  found  in  The  Art  of  Developing  a 
Career  (:• iel  and  Carkhuff  197^) 

Selection  of  Participants  - 

/ill  Pontir?c  tt^cichern  and  councelor?^  wo^e  asKed  to  apT5ly  for  participa- 
tion ir  t\c  CAST  prn/rotr.  by  co.-nplotinn  ^  hunant  education  and  career  selection 
inventorier  developed  by  Carkliuff  Associates.^    Teachex*s  were  chosen  based  on 
their  iavoxitory  ncorosi  f:rade  level  and  availability  for  a  two-week  workshop 
in  Au»-nint  1073^    Contf^nt  area  was  not  considered  important  in  the  selection 

'^Samples  and  a  description  of  the  inventories  can  be  found  in  the 
Phase  III  Final  Report  PROGHAM  EVALUATION  SECTION. 
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criteria.    We  were  tryinc  to  ider+ify  effective  teachers  who  coiAld  develop i 
deliver  and  disseminate  the  student  and  teacher  skills.    Therefore*  their 
content  specialty  was  secondary  to  their  overall  effectiveness  in  the  human, 
education  and  career  skill  areas. 
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Preparation  for  Trainiw?  - 

All  of  the  CAST  teachers  vrere  eent  a  pre-training  aasignment  so  that 
thev  would  have  some  base  of  understanding  before  training  began*  They 
were  asked 5 

1)  to  read  The  Art  of  Teachingt  (Carkhuff  t  Berenson,  Pierce  197^) 
The  Art  of  Helping  (Carkhuff  1972),  The  Art  of  Developing  a 
Career  (Friel  and  Carkhuff  197'*)  t  and  The  Art  of  Problem 
Solving.  (Carkhuff  197^) 

2)  to  se?.ect  the  parts  which  related  most  closely  to  their  need 

3)  to  discuss  these  sections  during  the  first  class*. 

Training  Procedures  - 

The  training  outline  was  as  follows; 

1)  An  overview  of  the  project  objectives  was  presented  and  the 
teacher's  role  and  responsibilities  defined. 

2)  An  overview  of  the  human,  educational  and  career  training 
was  ^iven  and  related  to  the  project  goals  which  were  pre- 
sented in  terms  of  student  outcomes* 

3)  Training  conditions  and  expectations  were  explained. 
'0    The  two-week  training  schedule  was  previewed* 

Mornings 

1)  The  huj^^an  achievement  modules  were  presented i  based  on 
Dr*  Carkhuff »s  book  The  Art  of  Helping  (Carkhuff  1972) t 
and  The  Art  of  Teaching  (Carkhuff ,  Berenson,  Pi^^  -ce  197^) 
This  was  done  in  a  large  group. 

2)  The  human  achievement  or  interpersonal  skills  wei^  then  prac- 
ticed in  small  groups  with  two  people  playing  the  roles  of 
helper  and  helpee  while  t^e  rest  of  the  group  gave  feedback. 
Each  group  had  a  trainer  who  was  a  counselor  from  last  year's 
program.    The  trainer  had  primary  responsibility  for  providing 
direction  and  feedback  for  the  group. 

3)  The  homework  assignment  was  given.    The  teachers  and  counselors 
were  to  practice  the  skills  they  learned  and  to  write  down  vAiat 
happened  as  a  result  of  their  use.    These  results  would  be  shared 
the  following  morning. 
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Afternoons 


1)  The  career  achievement  skills  were  taiight  in  a  large  group  to  the 
teachers  and  counselors  using  the  Phase  II  Lesson  Plan  Manual »  (See 
Appendix  B) 

2)  The  elementary  and  junior  high  comic  book,  The  Story  of  Who  (Friel  and 
Carkhuff  197^)  was  used  as  a  visual  model  for  the  CAST  program* 

3)  The  Art  of  Problem  Solving  (Carkhuff  197^)  was  given  as  a  homework 
assisnmeut  along  with  the  career  decision-making  assignment. 

h)    The  career  achievement  homework  assignment  was  having  the  teachers 
and  counselors  become  students  and  do  the  lessons  in  the  Phase  II 
Lesson  Plan  I^Ianual.    It  was  felt  that  only  if  the  participants 
had  £one  throuch  the  manual  as  a  student  would  they  be  able  to 
effectively  deliver  the  program  to  their  students*    In  addition, 
they  ^^^ere  asked  to  list  ways  they  might  deliver  each  lesson.  This 
gave  each  teacher  a  pool  of  strategies  from  which  he/she  could 
choose  in  delivering  his/her  lesson. 

Second  Week  Afternoons 
After  the  teachers  and  counselors  v;ere  familiar  with  the  career 
skills,  the  afternoons  were  spent  learning  the  educational  skills  necessary 
to  further  develop  and  deliver  the  CAST  program.    The  Art  of  Teaching 
(Carkhuff,  Ber^^^pon,  Pierce  197^)  served  as  the  basis  for  this  training. 
Teachers  and  counselors  developed  and  practiced  delivering  their  own  lesson 
plans  to  other  members  of  the  group.    The  group  members  would  then  rate 
them  as  to  how  well  they  used  the  humar;,  educational  and  career  skills  they 
had  learned. 

Evaluation 

Teachers  were  evaluated  on  the  same  paper  and  pencil  inventory  they 
had  taken  in  the  beginning  of  the  profram.  This  gave  some  indication  of 
their  frrowth  due  to  training. 

Classroom  Observations 
Follov^-up  is  the  l:ey  to  effective  implementation  of  any  inservice 
propran^    Teaching  skills  during  a  two-week  workshop  does  not  assure  that 
they  will  be  used  correctly  in  the  classroom.    The  reason  for  this  is  the 
conditions  of  traininc  are  vastly  different  than  the  conditions  in  the 
classrcon.    Therefore,  to  insure  that  all  teachers  could,  in  fact,  use 
the  human,  education  and  career  skills  in  their  classroom  delivery,  period- 
ic  classroom  observations  were  made  by  the  trainers. 
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This  was  achieved  by  aasigning  each  trainer  one  or  two  teachera  to 
observe  and  follow-up.    Where  teachers  and  trainers  were  in  the  saioe  building, 
those  trainers  observed  those  teachers.    In  the  other  cases,  the  trainers  had 
flexible  schedules  which  allowed  them  to  observe  the  other  teachers  in  their 
respective  buildings. 

Scheduling  of  obse  '«vations  was  handled  between  the  teacher  and  trainer. 
In  the  beginning,  each  trainer  visited  the  classroom  once  a  week  for  the 
entire  CAST  class  period.    As  teachers  became  more  comfortable  and  proficient 
in  their  delivery  the  frequency  of  visits  was  much  less  and  for  shorter  periods 
of  time.    On  the  average  each  teacher  was  observed  approximately  five  times 

from  November  to  May. 

During  these  visits,  the  trainer  was  assessing  how  effectively  the 
teacher  was  presenting  the  career  content  as  well  as  the  effectiveness  of 
his/her  human  and  educational  delivery  skills.    To  perform  the  assessment, 
the  trainers  used  an  observational  checklist  developed  by  Carkhuff  Associates 
personnel.    (See  Appendix  A)     The  checklist  is  divided  into  the  following  five 
sections  used  to  record  the  organization  of  lesson  plan  delivery: 

Review    -    Inform  students  what  skills  they  had  learned  previously. 
Overview  -  Relate  ^^oee  skills  to  the  new  skills  for  that  day  and 

to  the  ultimate  goals  of  the  program. 
Presentation  -    Make  available  the  facts,  concepts,  principles  and 

discrimii-Ation  the  students  need  to  acquire  and  maintain 

the  skills. 

Exercise  -  Allow  students  to  practice  the  new  skill. 

Sumraary  -  Reinforce  the  day's  lesson  skills  and  relate  to  tomorrow's  skills. 
Within  each  of  the  above  five  sections  the  following  teacher  skill  areas 

were  observed  and  rated. 

1)  Methods  -  How  teachers  presented  material. 

2)  Content  -  At  what  cognitive  level  the  material  was  presented. 
5)    Strategies  -  If  and  to  what  degree  the  teachers  envolved  the 

students  in  the  learning  process. 
k)    Attending  -  Description  of  the  relative  physical  positioning  of 
the  teacher  and  student. 

5)  Responding  -  Quality  of  verbal  interaction  . 

6)  Reinforcement  -  Use  of  verbal  teacher  behavior  to  direct  students 
behavior  toward  a  predetermined  goal. 
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Usinc  a  five-point  scale  developed  for  each  area,  the  trainer  wo\zld 
record  all  the  teacher behaviors  for  a  ^5-^R^inute  period*    At  the  end  of  the 
observation,  the  trainer  would  have  a  profile  of  the  teacher's  delivery  in 
each  of  these  areas.    Based  on  this  information  the  trainer  would  briefly 
Cive  feedback  to  the  teacher  and  would  make  an  appointment  so  that  the  teacher 
and  trainer  could  discu55S  the  observational  checklist. 

During  these  follow-up  sessions  the  teachers  and  trainers  discussed 
the  career  content,  presentation  and  the  delivery  and  how  they  could  be  improved* 
The  checklist  was  used  to  select  the  area  where  the  tf^acher  had  the  greatest 
chance  of  improvement.    Together,  teacher  and  trainer  set  a  behavioral  goal 
within  the  deficient  area  and  wrote  a  program  which  the  teacher  would  practice 
for  the  next  observation. 

Teacher  pbservation_al  Training 
In  order  to  observe  and  develop  these  programs  for  teachers,  the  trainers 
:iad  to  be  trained.    Tliis  observation  training  was  conducted  monthly  by 
Dr.  David  Dercnson.    At  this  time  problems  and  areas  of  concern  regardinf; 
an^'  part  of  the  obpervfttion  and  follow-up  sessions  were  discussed  and  pr0£;rams 
developed  lo  rilleviatc  tht^in.    Here  is  an  example  of  one  trainer  observational 
projrx.i: 

Trainer  Observation  Program 
1.    Set  up  nj^pointrnent  with  trainee. 

?.    Cbr/jrvc  for  one  hour  a  v;eek  at  first  until  you  can  discriminate 

ar^--ir^  of  r^reatest  need. 
3.    Renpond  to  strength. 

Initiate  goal  and  program  for  area  needing  attention. 
I;.    Df^vclop  sm-ill  pronrarnr;  so  that  they  can  be  achieved  in  one 

vook^G  tine?. 

6.    Foedback  to  no  on  Friday  major  areas  needing  to  addressed 
at  univornit^'  class. 

Teacher  Follow-Up  Training 
Clio  ni(;ht  a  nonth  the  teachers  in  the  CAST  program  met  with  the 
traine:,-s  for  follow-up  training  sessions  for  which  they  received  credit  from 
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Wayne  State  University.    The  skills  the  teachers  were  having  difficulty  with 
were  reviewed  and  practiced.    Teachers  made  tapes  of  their  classroom  sessions 
and  reviewed  them  with  their  trainer  to  discuss  strengths  and  weaknesses. 

These  classes  were  valuable  to  the  teacher  and  trainer.  Teachers 
received  additional  skills  and  programs  plus  help  in  those  areas  where 
it  was  needed.    Trainers  had  a  chance  to  assess  where  the  group  stood  in 
relationship  to  the  skills  being  addressed  and  could  develop  their  programs 
to  help  the  teachers. 
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Outcomes  and  Recommendations 


The  followinc  training  areas  were  discussed  and  recoramendations  made  by 
the  CAST  teachers  in  a  final  evaluation  session  at  the  end  of  Phase  III. 
The  Project  Director  has  summarized  their  comments  and  reconrniendations  under 
the  following  training  areas» 

Human  Skills 

All  participants  felt  the  need  for  more  tradning  on  the  human  skills. 
They  recommended  that  the  training  proceed  at  a  slower  pace  allowing  them 
onoucH  time  to  internalise  their  new  discriminations  and  skills  before 
moving  on  to    .le  next  training  piece.    In  addition,  they  felt  that  the  human 
skills  should  be  introduced  and  practiced  within  their  own  content  area  before 
being  introduced  in  the  career  area.    Introducing  the  human  skills  in  the 
context  of  a  new  content  area  (career)  made  the  learning  of  the  human  or 
intt;rpcrGonal  rkills  nomcwhat  difficult. 

Also,  they  rc?comnended  practicing  the  human  skills  in  a  large  group 
setting,  in  addition  to  the  one  tc  one  practice,  so  that  they  could  learn 
to  ur>e  the  skills  uridc^r  conditions  similar  to  their  classroom  setting. 
Finally,  Ihoy  felt  that  taping  the  training  sessions  as  veil  as  their  class- 
**oom  dv'^liucry  woulc^  help  then  make  finer  discriminations  in  assessing  their 
own  hu..ian  skill  development. 

Educational  Skills 

As  in  the  hur.an  skills,  the  participants  urged  that  more  time  be  spent 
learning  the  educational  skills.    Particularly  emphasis  they  felt  should  be 
plncod  on  cl'.^Yelopinr;  learning  strategies  and  content  (facts,  concepts,  prin- 
ci^l'^f^^i  r>allr.  ami  pronrans)  skills  in  these  areas  would  assist  the  teachers 
in  inclividuadiring  and  extending  the  curriculum  to  meet  the  needs  of  their 
students  in  their  class.    The  teachers  also  recommended  spending  more  time 
developing  strategies  for  delivering  the  career  skills  so  that  they  could 
have  been  more  prepared  when  beginning  to  teach  CAST. 

Career  Skills 

The  teachers  felt  going  through  the  CAST  program  as  students  themselves, 
v;as  essential.    In  this  way  mastery  of  the  content  vras  more  assured.  Once 
having  learned  the  cai*eer  content  skills  they  could  practice  the  delivery 
process  which  includes  the  use  of  the  human  or  interpersonal  skills  and  the 
educational  skills.    Teachers  trying  to  be  both  student  and  CAST  teacher  at 
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the  same  time  they  got  confused.    When  this  happens  their  undorstandinc  of 
the  integration  and  relationship  of  the  human  and  the  career  skills  is 
inconiplete. 

General  Comments 

Of  all  the  training  skills  the  teachers  felt  that  the  human  and  educa- 
tional nkilln  to  be  the  most  valuable.    They  felt  that  these  skills  had 
helped  thoni  grow  personally  and  professionally.    (See  Appendix  T)  Tliese 
ar?  also  the  ski?. Is  that  were  most  generalized  into  their  own  content  areas. 
T':us,  the;-  vero  seeing  positive  results  in  their  speciality  area  as  well  as 
ia  the  oareer  a'rea. 

Observations      (Sec  Appendix  A  for  our  checklist) 

The  teachf-rs  felt  there  was  a  need  for  fewer  and  more  indepth  assess- 
HiOnt  (finer  dincriminations)  of  the  teachers  deficit  area  so  that  propracs 
onulcl  b-!  tf^ilorcd  to  individual  needs.    Some  teachers  felt  that  more  time 
FJiv'kuld  be  spont  rivin,^  feedback  on  one  skill  area  of  deficit  while  other 
toachern  felt  thoy  wanted  to  know  about  all  areas.    They  also  recommended 
that  one  sriill  area  be  focusod  on  and  programs  developed  and  practiced 
before  i^ovinr:  on  to  anothei-  skill  area.    Jumping  ahead  before  mastery  of 
any  aroa  left  the  teachers  frustrated  and  unsure  of  their  progress.  The 
teachex^s  sugpestod  that  one  way  to  overeome  their  frustrated  feelings  was 
to  use  a  recording  system  where  the  teachers  could  chart  their  progress 
so  that  they  could  see  their  own  growth  as  they  mastered  each  skill  area. 

Follow-up  Training 

Most  teachers  found  the  Wayne  State  University  class  to  be  helpful  in 
providing  them  a  chance  to  receive  feedback  and  training  in  new  skill  areas* 
How<»ver,  it  waf?  suggested  that  more  time  ^ould  have  been  spent  on  skill 
training  and  less  on  information  giving.    In  other  wordSi  the  content  of  the 
class  could  have  dealt  more  specifically  with  the  areas  targeted  from  class-* 
room  observations.    The  teachers  did  feel  that  this  class  was  beneficial  in 
helping  then  bridge  the  gap  between  the  summer  inservice  and  their  classroom 
delivery. 
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Conclusions and  Suggestionc 
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The  followinc  statements  are  general  conclusions  drawn  from  the 
Outcorner  ami  Reconmendations  Section: 

1.  CAST  ino^rvice  training  is  recommended  for  delivery  of 
the  CAST  program* 

?.    The  air.ount  of  training  is  dependent  on  the  level  of 
functioning:  of  the  trainees* 

The  quality  of  training  is  dependent  on  the  level  of 
functioning  of  the  trainers  and  the  level  of  their  train- 
iuf  i^^orran* 

Tlio  training  should  be  composed  of  hunan^  education 
and  career  skills. 
5*    Follovr-up  traiiiing  should  continue  all  year  and  should 
be  based  on  the  observed  needs  of  the  teachers  and 
counr.olors. 

6.    Teachers  and  counselors  should  be  trained  to  transfer 
the  nkills  into  their  own  content  area* 
Clascroon  observations  arc  essential  to  insure  that  the 
teachers  and  counselors  are  using  the  skills  appropriately. 

8^    University  credit  should  be  given  for  the  depth  and  exten- 
siveness  of  this  training. 

9»    Teachers  and  counselors  who  have  delivered  the  program 
effectively  and  have  the  skills  to  train  others  should 
become  trainers  of  the  next  group  of  teachers  and  counselors. 
10.    Teachers  and  counselors  grow  personally  as  well  as  professionally 
from  the  training. 

Sor  "  ru/;:^:ostions  to  those  readers  who  are  interested  in  using  the  CAST 
^M*ogrriu  but  -ir-  not  suro  ^^/hethcr  or  not  trairing  is  necessary. 

1*    Assess  your  teachers  to  see  if  they  can  do  the  CAST  skills. 

2.  If  t'^ey  can*t»  find  someone  v;ho  can  teach  them.  (This  some- 
one should  have  delivered  the'  CAST  program  successfully  like 
the  Carkhuff  consultants  or  the  Pontiac  CAST  trainers.) 

If  you  can*t  find  or  affor|i  someone  to  teach  them,  I  would 
suggect  thif?  simple  training  procedure  after  first  having  had 
Lho  teacher  read  The  Work  Skills  Series. 
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A*    Using  the  Phase  II  Lesson  Plan  Manual,  have  the  teachers 
read  and  do  the  lessons  as  students* 

B.  Then  have  them  write  their  own  lesson  to  deliver  r'  e 
C3AST  objectives.  (Encourage  them  to  increase  the 
number  and  quality  of  their  methods  and  strategies.) 

C.  Have  them  practice  delivering  their  lesson  to  the  group. 

D.  Have  the  group  give  feedback  as  to  strength  and  weakness 
of  the  delivery. 

E.  ^Ixve  teachers  use  the  Phase  III  Lesson  Plaii  Manual  with 
the  Working  Skills  Series  as  support  to  deliver  the  program 
to  their  students. 

F.  Have  a  paster  teacher  who  is  delivering  the  program 
nh?orve  the  teachers* 

G.  Provide  ongoing  sessions  where  teachers  can  discuss  their 
material ^problems  and  concerns* 

Tiio  above  trrdning  procedure  is  only  recommended  after  all  other  training 
alternativos  have  been  exhausted.    By  using  the  Carkhuff  consultants  and/or 
Pontiac  CAST  trainers  a  level  and  quality  of  program  delivery  can  be  assured. 
Because  v;c  have  never  delivered  the  prograir.  without  consultant  trainers,  it 
is  ir:porniblo  to  state  v/hether  or  not  the  CAST  program  would  be  successful  in 
your  site  vitl.out  this  support.    This  is  an  important  question  to  be  researched. 

If  you  nr-  iritv rested  in  deliverinc  CAST  in  your  setting, and  want  help, 
write  Project  CAST/PALS,  Irving  Slementary  School,  I83O  W.  Square  Lake  Boad, 
Pontiac,  Michigan* 

Aire,  if  you  v;nnt  or  need  conr>xiltant  help,  contact  Carkhuff  Associates, 
P.  C.  3ox  Anhcrrt,  Kaspachuretts  OlOO;?. 
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Curriculum  Development 

As  was  explained  in  the  proceeding  section, during  Hiaee  II  of  the  project, 
teachers  and  counselors  were  trained  by  Dr.  Ted  Friel,  Dr.  David  Bereneon 
and  Dr.  Hichard  Pierce  from  Carkhuff  Associates  to  develop  and  deliver  this 
Career  Achievement  Skills  Training  (CAST)  program. 

Using  the  books  from  the  Carkhuff  Working  Skills  and  Life  Skills  Series 
(Carkhuff  1973)  and  their  curriculum  development  skills  learned  in  the 
Carkhuff  inservice  training,  the  teachers  and  counselors  developed  their 
own  lessons  which  they  used  to  deliver  the  CAST  objectives. 

At  the  end  of  Phase  II  all  teachers*  and  counselors*  revised  and  modified 
lesson  plans  were  reviewed  by  two  CAST  participants  and  developed  into  a 
Phase  II  Junior  High  Lesson  Plan  Manual.    (Appendix  B)   These  lessons  included 
two  components:    1)    "Student  Procedure  Sheets"  -  behavioral  and  sequential 
steps  leading  to  attainment  of  the  career  skill.    2)    •'Teacher  Procedure 
Sheets"  -  instructional  program  steps  containing  a  method  and  strategy  for 
teachers  and  counselors  to  use  in  teaching  the  student  steps. 

This  Phase  II  Lesson  Plan  Manual  was  developed  primarily  as  a  tool  to 
use  during  Phase  III  of  the  project  in  training  the  new  CAST  participants 
in  the  CAST  skills  they  would  be  teaching  their  students.    The  jxinior  high 
and  high  school  teachers  and  counselors  used  the  Phase  II  manual  as  written, 
while  the  elementary  teachers  and  counselors  had  to  modify  and  simplify  some 
of  the  skills  and  methods  as  they  proceeded. 

After  using  the  Phase  II  Junior  High  Lesson  Plan  Manual  during  Phase  III 
of  the  project  again  revisions  and  grade  level  changes  were  found  to  be 
necessary.    (See  PHDOHAM  DESCRIPTION  SECTION  of  the  Phase  III  Final  Report 
for  a  description  of  the  changes)    Therefore,  during  the  last  month  of 
Phase  III  the  following  major  changes  in  the  Phase  II  Lesson  Plan  Manual 
were  made: 

1.  The  Phase  II  Junior  High  Lesson  Plan  Manual  was  revised  and  a  Phase 
III  Junior  High  Lesson  Plan  Manual  developed. 

2.  From  the  Phase  II  Junior  High  Lesson  Plan  Maiiual  a  Lower  Iltmentary 
and  Upper  Elementary  Phase  III  Laseon  Plan  Manual  M  devalopad  M.ch 
contained  most  of  the  skills  presented  at  tha  junior  high  leval,  but 
simplified  and  related  to  the  developmental  needs  ot  elamentary 
school  students. 
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TheM  Pbase  III  manualo  were  developed  primarily  for  uae  by  the  teachers 
and  counaelors  ae  delivery  toolB  aot  as  inserdce  training  tools  as  described 
in  the  Phase  II  manual.    Thus,  the  reason  for  the  change  in  purpose  of  the 
Phase  XII  manual  was  because  the  teachers  and  counselors  had  already  acquired 
the  career  skills  using  the  Phase  XI  manual  and  thus  thorou^y  knew  the 
learning  process  necessary  to  achieve  the  CAST  skills.    VJhat  they  needed 
was  a  lesson  plan  manual  which  would  provide  them  an  increased  number  of 
methods,  strategies,  programs  and  resources  from  vAiich  they  could  draw 
upon  to  teach  the  learning  process  and  thus  increase  their  chance  of  reach- 
ing more  students.    Therefore,  the  Riase  III  Lesson  Plan  Manuals  were 
developed  to  meet  their  need. 
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Qutcomea  >nd  aecoaawndatioaa 


Thm  Mfv  a  ftw  problema  with  the  Pbiw*  II  Uaeon  Plaui  MatxuaO..    In  the 
beginning,  for  example,  the  teachers  feXt  that  the  lessona  were  too  lock- 
otep  and  little  room  waa  given  for  adding  any  of  their  own  ideas  amd  activities. 
However,  over  time  the  teachers  felt  more  comfortable  with  the  program  and 
modified,  deleted  and  added  activities  when  needed.    In  addition,  they  felt 
the  students  were  filling  out  too  many  charts  and  stressed  the  need  to  balance 
the  charting  process.    They  recommended  that  the  lesson  plan  include  more 
ideas  for  activities  from  \Aiich  the  teachers  could  choose.    With  a  range  of 
activities,  all  atudents  could  successfully  progress  at  their  own  level  and 
rate.    Finally »  they  felt  the  expanding  area  could  have  been  more  extensive 
because  students  need  a  broader  understanding  of  jobs  and  themselves  before 
they  move  into  the  narrowing  process. 

Based  on  these  recommendations,  a  Fhase  III  Elementary  and  Junior  Hi^ 
Lesson  Plan  Manual  was  developed*   Some  of  the  changes  included; 

1)  Resequencing  some  objectives, 

2)  Combining  one  and  two  objectives  in  one  lesson, 

3)  Leaving  out  some  objectives  (l^  and  17)  which  were  too 
difficult  for  our  students  at  this  time. 

k)    Simplifying  the  decision-making  process, 

5)  Combining  the  teacher  and  student  procedures  on  one  page, 

6)  Adding  support  programs  -  parent  -  counselor, 

7)  Adding  activities  vAiich  would  relate  the  career  skills  to 
oth^r  content  eAreats. 

8)  Tskir^  the  major  objectives  and  developing  an  upper  and 
lower  elementary  losson  plan  manual. 

If  these  Phase  III  Lesson  Plan  Manuals  are  to  be  used  appropriately 
teachers  must  first  be  trained  in  the  skills  tney  expect  their  students  to 
acquire.    Thus,  it  is  recommended  that  the  Phase  II  Lesson  Plan  Manual  be 
used  (along  with  the  books  from  the  Carkhuff  Working  SkUla  and  Life  Skilla 
Series)  as  a  tool  to  train  teachers  in  acquiring  the  learning  process  of 
the  CAST  skills  while  the  Phase  III  manuals  be  used  in  training  teachers. in 
delivering  the  CAST  skills  to  their  students. 
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Additional  Outcome s 


At  the  senior  hich  level  the  CAST  project  was  extended  and  administered 
under  a  new  project  called  Pontiac  Adult-Student  Learning  System  (PALS). 
(See  •'Other  Information"  in  the  PSOORAM  EVALUATION  SECTION) 

The  Pontiac  Adult-Student  Learning  System  is  an  academic  class  offered 
to  high  school  students  within  the  Pontiac  School  District.    This  course 
teaches  students  communication  skills  which  are  necessary  in  dealing  with 
adult  employees,  the  decision-making  process  which  they  use  in  selecting 
an  internship,  and  program  development  skills  which  the  students  use  in 
developing  programs  to  take  them  from  where  they  are  to  where. they  want  to  be. 
The  students  spend  approximately  25  classroom  hours  exaoiniag  their  skills ♦ 
values,  aspirations  and  career  alternatives.    Following  and  as  a  result  of 
the  classroom  experience,  the  students  use  their  decision-making  skills  to 
select  jobs  within  the  community  on  which  they  will  be  placed      an  intern. 
The  students  spend  a  minumua  of  one  hour  a  day  for  five  to  six  weeks  ob- 
serving as  adult  employee  so  that  they  can  identify  the  skills  necessary  to 
hold  down  that  job. 
Conclusions 

Teachers  and  counselors  need  to  be  trained  in  how  to  develop  tbeir 
own  CAST  lessons  so  that  they  can  break  down  the  skills  when  necessary 
and  can  develop  individual  programs  for  students  .    Handing  teachers  a 
"prepared  cookbook  curriculum"  does  not  leave  room  for  then  in  the  develop- 
nent  or  aeiivery  process.    Thueithe  progran  is  not  really  thsir*. 

Dif /erent  parts  of  the  CAST  prograa  need  to  be  eopbasised  at  different 
grade  levels.   Thus,  the  lesson  plan  aanuals  can  serve  aa  guidea  for  tetehera 
in  their  delivery.    IdeaUy,  studanta  abould  learn  a  rudiaentary  varaion  of 
CAST  in  their  kindergarten  and  early  eleaentary  yeara  (Ibaae  lH  Laaaon  Plan 
Manual  -  Lower  Elementary).    They  would  develop  their  akilla  further  In  the 
later  elementary  years  (Phase  III  Leaaon  Plan  Manual  -  Upper  Slaaentary) 
and  increase  the  complexity  and  tine  spent  on  the  akilla  during  the  junior 
high  years  (Phase  III  Lesson  Plan  Manual  -  Junior  Sigh),    finally*  at  the 
high  school  level  the  atudenta  would  learn  the  akilla  at  a  aore  aophiaticated 
level  and  with  greater  profeciency  (Idea  Book  for  a  Seeondary  Career  Iduoation 


39 

ERIC  31 


Program  -  PALS  Project  Curriculuo) .  Using  these  lesson  pXsn  mwiusls 
guides,  the  teachers  snd  counselors  csn  continue  to  add  their  ideas  : 
delivery,  thus  increasing  the  quality  and  quantity  of  their  teaching 
methods* 
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Curficulum  Delivery  - 

The  delivery  schedules  varied  with  classes  and  grade  level.    At  the 
elementary  level,  the  teachers  delivered  the  program  2-5  times  per  week 
in  half-hour  blocks.    The  7th  and  8th  grade  junior  high  programs  were 
somewhat  more  sporadic.    Most  of  the  teachers  didn't  get  started  until 
October  as  they  wanted  to  get  their  own  content  area  under  way.    "ihen  they 
taught  the  program  once  per  week  if  poF-F.ible.    Sometimes  they  had  to  skip 
a  week  or  two  depending  on  vacations,  other  priorities,  etc.    The  9th  grade 
program  was  different  still-    It  was  being  taught  in  a  nine-week  mini-course. 
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Outcomes  and  Recommendations 

Tliere  were  some  problems  with  the  delivery  time  schedule  at  the  junior 
hifrh  level.    Spread inc  the  delivery  over  a  one-year  period  was  too  long  a 
span  of  time  for  our  students.    Continuity  and  daily  reinforcement  of  the 
skills  v/ere  lost.    Too  much  time  was  spent  in  reviewing  the  skills  that  had 
been  previously  taught,  rather  than  in  practicing  the  new  skill.    The  following 
alternative  ways  of  deliverinf^  the  program  were  recommended: 

1  -  With  the  program  spread  out  many  students  lost  interest  in 
working  toward  their  internships.    A  year  was  too  long  to 
use  the  internship  as  a  reward. 
?  -  The  program  should  be  taught  early  in  the  year  so  students 
;,ave  a  chance  to  get  out  on  their  internships  while  their 
motivation  is  high. 
Many  teachers  faced  internal  scheduling  conflicts.    Conflicts  ir  ^nding 
ti:ne  to  deliver  their  regular  subjects  and  the  career  program.     It  y^z 
recommended  that  time  be  spent  on  reorganising  their  subject  matter  content 
as  to  deliver  it  more  efficiently.    One  way  of  doing  this  is  to  integrate 
the  career  skills  within  their  subjects.    Another  way  is  to  tighten  their 
subject  matter  delivery  so  there  is  a  block  of  time  for  careers. 

At  the  elementary  level,  the  teachers  delivered  the  program  in  1^2  hour 
blocks  2- J-  tines  per  week.    This  frequency  and  amount  of  time  for  each  de- 
livery v/orked  out  very  well  as  the  young  students  needed  the  skills  intro- 
duced in  sn^.aller  pieces  and  also  needed  more  time  to  practice  each  piece. 
Rocommendations  at  the  junior  hi^h  level  - 

1)  Have  teachers  teach  the  program  every  day  in  a  three-week  block 
of  time  or  at  least  three  times  per  week. 

2)  Set  up  a  10-week  mini-course  or  a  semester  coiirfle  so  that  all 
the  skills  could  be  delivered  thoroughly. 

3)  Have  the  counselor  deliver  part  of  the  programi  with  the  class- 
room teacher. 

4)  Have  the  counselor  deliver  the  CAST  program  as  a  course. 

^)    Use  skills  within  regular  content  area  where  ever  possible. 

6)    Emphasize  exploration  and  decision-making  at  junior  high  level. 

Reco!^mendntions  at  the  elementary  level  - 

1)  Start  the  program  at  the  beginning  of  the  year  and  continue  it 
throughout  the  year. 

2)  Integrate  the  CAST  program  with  subject  area. 

3)  Emphasize  exploration  phase  at  elementary  level. 
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Conclusions 


The  CAST  Program  shoa^d  be  delivered  in  one  block  of  time  even  if 
it  means  delivering  only  ot\e  part  of  the  program  for  each  of  the  expanding, 
narrowing  or  preparing  sections.    To  spread  the  program  out  over  a  long 
period  of  time  delutes  its  effectiveness* 

The  CAST  program  is  best  delivered  where  a  teacher  and  coimselor  can 
work  together  each  delivering  the  areas  for  which  they  are  best  prepared. 

The  CAST  program  should  be  integrated  with  the  existing  ciirriculum 
wherever   possible.    This  entails  having  classroom  teachers  reevaluate 
what  they  are  teaching  and  why  they  are  teaching  it  and  i.jw  they  are 
teaching  it.    Only  if  their  own  content  delivery  is  ti^tened  will  there 
be  time  to  deliver  CAST. 

Wherever  possible  teachers  delivering  CAST  should  plan  and  coordinate 
efforts  in  their  delivery.    In  this  way  the  benefits  of  each  teacher's 
unique  contributions  are  shared  among  all  students. 
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Internship  Component 


Description 

The  internship  experience  was  the  heart  of  the  CAST  program*  CAST 
3tudent£3  spent  an  hour  or  noro  with  a  person  working  in  the  job  which  the 
students  has?  f=;electc?d  using  the  decision-making  process  they  had  learned* 
Small  and  large  groups  of  students  exploring  the  same  job  would  observe 
the  vork  rtettir^:  and  then,  interview  the  employee  by  asking  questions  about 
v;hat       required  of  hir/her  on  the  job*    With  this  infornationi  the  students 
vould  re-evaluate  their  decision  to  determine  if  the  job  was  more  or  lesr. 
favor^^ble  to  them  based  on  the  new  information  acquired  from  their  "people 
?ourc-o'^    (Students  in  CAST  learned  to  gather  information  for  their  decieion 
from  people  and  thin^.  sources  -  the  internship  was  the  main  people  source*) 

As  mentioned  above,  the  size  of  the  group  varied  with  internships*  Some 
internships  involved  two  or  three  students  and  others  as  many  as  20*  The 
larger  groups  were  interested  in  (Exploring  the  jobs  of  secretary!  lawyer i 
forest  ranger,  stet^ardess,  nurse,  doctor,  engineer,  police  person,  teacher 
and  sports*    The  smaller  groups  explored  archeologist ,  accotmtant,  writer, 
astronaut  and  actress* 

Coordination 

An  internship  aide  was  hired  to  coordinate  the  internship  arrangements 
between  three  schools*    This  was  a  total  of  eight  classes  and  some  200  students* 
She  worked  approximately  15  hours  per  week  for  five  weeks*    Her  major  respon- 
sibilities included: 


1) 

2) 
3) 

5) 


scheduling  internships, 
finding  internship  contacts, 
securing  internship  placements, 
arranging  transportation, 
utilising  support  people, 
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Scheduling  Internships 

Internships  were  scheduled  at  the  convenience  of  the  30  participating 
employers*    ThuS|  the  students  would  be  scheduled  for  an  internship  anytime 
during  the  school  day  or  on  the  weekend ^  if  necessary •    Because  the  students 
were  being  taken  out  of  class,  the  internships  were  kept  to  an  hour.  The 
entire  internship  prograip.  itself  was  scheduled  over  a  three  to  four  week 
period,  beginning  the  first  part  of  April* 

Finding  Internship  Contacts 

Many  groups  of  people  were  used  as  sources  for  internship  contacts. 
Parents,  trainers,  friends  and  teachers  were  used  to  generate  names  of 
people  to  contact  for  Internship  Placements.    These  names  were  kept  in  an 
Internship  Contact  File.    This  file  was  begun  last  year  for  the  internship 
program  and  served  as  a  good  source  of  names. 

Securing  Internship  Placements 

Local  people  were  utilized  as  internship  placements  for  the  students • 
selected  jobs.    Occasionally  students  would  have  to  go  out  of  town,  but  this 
was  kept  to  minimum  because  l)  local  involvement  of  business  and  industry 
personnel  in  the  career  program  was  encouraged  and  2)  transportation  costs 
were  to  be  minimal. 

Employers  were  first  contacted  by  phone  and  explained  the  purpose  of 
the  CAST  program  and  their  role  in  the  internship  phase.    Then  a  date  and 
tine  was  set  up  for  the  internship.    They  were  sent  a  list  of  student  ques- 
tions which  they  were  required  to  answer  when  the  students  arrived.  After 
the  internship,  the  employers  were  sent  a  thank  you  letter  and  a  postal  card 
on  which  to  write  their  responses  concerning  the  internship. 

Arranging  Transportation 

Finding  adequate  transportation  was  difficult.    School  buses  could  not 
be  used,  so  parents,  teachers  and  counselors  drove  where  possible.  In 
addition,  some  project  money  was  spent  to  rent  a  mini-bus  which  transported 
fifteen  students  at  one  time. 
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utilizing  Support  People 

While  the  internship  aide  prepared  the  employers  for  the  students, 
the  teachers  prepared  the  students  for  the  employers.    Teachers  had  students 
prepare  questions  to  ask  and  then,  had  the  students  practice  their  interview 
prograns-    In  addition,  the  students  developed  internship  readiness  programs 
which  included  sendinc  a  letter  to  their  parents  explaining  the  internship, 
setting  permission  from  their  parents,  as  well  as  clearing  their  absence 
with  other  teachers.    (See  the  Phase  III  Lesson  Plan  Manual)*  Following  the 
internships,  the  students  evaluated  them  as  to  whether  or  not  they  would 
reconmend  the  placement  for  the  following  year. 

Teachers  were  notified  prior  to  the  internship  as  to  v»iat  students 
would  be  £oing  on  their  internships,  on  what  day  and  at  what  time.    If  a 
driver  or  adult  supervisor  (an  adult  who  would  accompany  the  students  on 
their  internship)  was  needed,  the  teacher  would  be  asked  for  suggestions. 
(If  at  all  possible,  the  teachers  would  go  with  their  students.)  The 
internship  aide  would  check  with  the  teachers  following  the  internship  to 
assess  how  valuable  the  students  had  found  the  experience. 

Counselors  (trainers)  were  utilized  as  a  liason  between  the  teacher 
and  the  internship  aide.    They  assisted  with  transportation  and  internship 
placement  needs.    They  were  also  informed  as  to  what  and  when  students  were 
going  on  internships,  so  that  they  could  help  supervise  the  arrangements. 


*  For  information  see  Appendix  L 
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Outcomes  and  Recommendationa 


The  following  paragraphs  will  address  the  major  outcomes  of  the  intern- 
ship program  and  will  include  recommendations  for  planning  future  internships. 

Internship  Coordination 

Although  having  a  part-time  aide  arrange  internships  saved  the  teacher 
time^  it  did  create  communication  and  coordination  problems  within  and 
between  schools.    Many  teachers  felt  they  did  not  have  the  time  to  coordinate 
the  internships.    Others  felt,  if  given  time,  they  were  in  a  better  position 
to  arrange  internships  around  their  own  schedules  and  for  their  own  students. 
This  would  give  them  a  greater  responsibility  for  the  success  of  the  intern- 
ship if  their  time  was  invested  in  coordinating  the  internship  program. 
V/orking  through  a  second  party,  they  felt,  caused  them  to  lose  some  of  their 
close  involvement  with  the  internship  program.    It  also  complicated  the 
communication  of  informs'^ ion  to  all  the  people  affected  by  the  internship 
program*    Thus,  the  following  alternatives  were  suggested  for  internship 
coordins(tion. 

1.    Each  teacher  coordinates  his/her  own  internships.    Time  must  be 
given  to  make  contact,  -placements  and  secure  transportation*  For 
example,  substitutes  could  be  used  to  release  the  teacher  to  plan 
internships. 

?..    All  teachers  within  one  school  who  are  involved  in  the  CAST  program 
«-ould  coordinate  their  internship  efforts,  share  contacts,  place- 
ments, buses,  etc. 

3,    An  internship  aide  within  each  building  could  arrange  all  intern- 
ships and  in  addition,  an  overall  coordinator  could  be  hired  who 
had  public  relations,  community  and  CA5T  background. 

k.    School  counselors  could  secure  internships. 

5.    Students  could  find  their  own  internships. 

In  general,  it  was  felt  that  teachers  should  be  involved,  to  some 
degree,  in  coordinating  the  internships  because  of  the  importance  of  the 
program  in  enhancing  teacher-conununity  relationships.    The  internsiiip 
program  allowed  community  personnel  and  teachers  to  communicate  about  the 
educational  needs  of  students.    It  offered  both  teachers  and  community  personnel 
an  opportunity  to  work  together  in  a  very  concrete  way.    It  gave  both  parties 
a  chance  to  see  the  role  the  other  played  and  could  play  in  helping  young 
people  plan  their  career. 
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Finally I  it  allowed  students  the  opportunity  to  learn  how  to  use  community 
resources  as  a  rich  source  of  learning  about  themselves  and  others* 

Scheduling  Internships 

It  was  difficult  scheduling  all  internships  in  a  three  to  four  week 
block.    There  would  be  more  opportunities  for  including  different  kinds  of 
internships  if  the  coordinator  could  offer  the  employer  a  wider  range  of 
alternative  dates.    Also,  if  the  employer  contacts  were  made  early  in  the 
year  for  those  jobs  in  which  most  students  wanted  internshipst  then  there 
would  not  be  the  rush  to  set  them  all  up  at  once.    If  the  internships  were 
staggered  over  a  two-month  periodf  then  this  would  be  less  disruptive  for 
the  teachers  whose  classes  they  would  be  missing. 

Finding  Internship  Contacts 

Finding  internship  contacts  was  not  difficult  for  the  internship  aide. 
The  following  steps,  which  she  followed  in  identifying  names  and  arranging 
the  internships,  were  also  recommended  for  the  classroom  teacher. 

1.    Send  a  letter  to  parents  asking  for  names  of  potential  internship 
contacts. 

?.    Contact  personal  friends  and  have  them  ask  their  friends. 

3.    Ask  other  teachers  to'  contact  their  friends  for  names. 

Use  local  or  county  Career  Speaker  Hesource  File.    (The  CAST 
Internship  File  from  last  year's  internship  placement  was  a 
valuable  resource — each  school  could  have  their  own  file  which 
could  be  added  to  each  time  an  internship  placement  was  made.) 

A  major  recommendation  concerned  using  the  computer  to  file  all  the 
names  of  people  willing  to  give  their  time  for  internships*    This  would 
include  all  the  past  internship  contacts.    The  computer  would  allow  immediate 
retrieval  of  their  names,  addresses  and  frequency  of  use  of  possible  intern- 
ships.   This  information  must  be  easily  updated  and  should  provide  some  form 
of  evaluation  by  the  student  as  to  the  appropriativeness  of  the  internship. 

Securing  Internship  Placements 

More  lead  time  was  necessary  for  internship  placements.    It  was 
recommended  that  as  soon  as  the  students  have  selected  their  two  jobs,  the 
internship  contacts  should  be  made.    A  two-month  block  of  time  should  be 
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•IXoved  for  these  placements.  It  vas  also  reconmended  that  emplbyers  b« 
better  prepared  for  their  intern  student.  -The  following  are  reconaaended 
steps  to  inprove  the  internships.  • 

1*   Contact  employer  and  explain  the  CAST  program  and  reason  for 
the  internship. 

2.   Sxplain  what  >  /she  can  expect  f^m  students  as  well  as  what 
students  can  expect  from  him.   Also,  find  out  any  special 
instructions  needed  for  internship. 
3.   Arrange  time  and  date  for  internship.  ^ 
k.    Send  him/her  a  letter  explaining  what  questions  the  students  will 
be  asking  as  weU  as  reminding  him  of  what  he/she  has  promised  to 
do  for  the  students.    Include  the  list  of  students,  the  nwne  of 

the  adult  supervisor,  the  date  and  time  of  the  internship.  (If 
this  arrangement  is  being  made  far  in  advance,  a  reminder  should 
be  sent  to  the  employer  a  little  before  the  internship.) 
5.   Visit  employer  personiOly  before  the  internship,  if  possible.  This 
would  allow  the  teacher  to  explain  step  by  step  what  the  employer 
would  have  to  do  for  the  internship  as  well  as  answer  any  of  his/her 
questions.   This  visit  would  be  particularly  helpful  in  briefing 
the  employer  on  how  he  mig|it  deal  with  different  age  levels. 

Arranging  Transportation 

locating  transportation  was  the  most  difficult  part  of  the  internship 
pTOgram  this  year.   Sever.^  strategies  were  recommended.   One  reeommexidation 
was  that  if  school  buses  were  not  available,  all  possible  parent  drivers 
should  be  contacted  early  in  the  school  year,  so  that  a  driver  pool  could 
be  formed.   Then  when  drivers  would  be  needed,  there  would  be  a  list  from 
idiich  to  work.    If  large  numbers  of  classes  were  involved,  two  or  three 
foil-time  drivers  might  be  hired  to  shuttle  students  to  and  from  internships. 
It  was  also  recommended  that  counselors,  principals  and  community  workers 
be  used  to  transport  students. 

UtilizinE  Support  People 

The  particip*ints  felt  that  the  students  were  well  prepared.    The  oriy 
cufcostions  were  that  the  students  write  out  their  questions  beforehand,  so 
thvJt  they  vould  be  risRured  of  netting  all  of  their  questions  answered.  The 
^artlci-.iants  stronf^ly  felt  that  after  the  internships  the  students  should 
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objectively  evaluate  the  experience  aa  to  ita  approprLateneas  for  future 
iAtemahipa*   Thia  might  eliodoate  thoae  people  who  believe  that  a  "quick 
trip  around  the  place"  waa  the  goal  of  an  internship* 

The  counselor's  role  was  seen  as  a  coordinatort  chaffeur  and,  by  mm, 
as  the  deliverer  of  the  program  either  in  its  entirety  or  at  least  those 
parts  dealing  with  internships  and  decision  making. 

General  Suggestions 

Internship  Alternatives 

Because  of  internship  transportation  problems  and  students  lacldng 
interview  experience,  it  was  strongly  recommended  that  a  series  of  graduated 

internship  experiences  be  established.   This  would  help  keep  the  transpor- 
tation needs  to  a  minimum  and  would  insure  that  students  would  not  be  sent 
out  on  an  internship  until  they  were  ready  to  handle  the  experience.  Sox^ 
a  plan  mi^t  look  like  the  following,  vMch  includes  a  series  of  steps 
starting  with  the  least  difficult  and  ending  with  the  most  difficult. 
10   Internship  -  alone  for  minimum  of  one  hour  at  employer's  place 
cf  business 

9   Internship  -  group  i^-^)  for  minimum  of  one  hour  at  employer's 

place  of  business 
8    Interview  role  model  in  class  -  alone 
7   Interview  role  model  in  class  -  part  of  panel  or  in  group 
6   Ask  questions  as  part  of  group  on  field  trip 
5  Observe  and  write  down  questionc;  to  ask  while  on  field  trip 
k   Interview  school  person  in  class  -  alone 
3   Interview  school  person  -  part  of  panel  or  in  group 
2    Interview  parent  at  home 
1   Bole  play  interview  in  class 

The  teachers  unanimously  agreed  that  every  student  must  have  some 
level  of  internship.    Different  grade  levels  could  select  the  appropriate 
internships  from  the  above  list.    With  the  above  steps  a  student  could  start 
at  the  beginninc  of  the  CAST  program  with  a  level  one  internship  and  progress 
to  whatever  level  is  possible  for  that  student.    Or    a  student  could  start  wit 
a  level  ten  internship  and  develop  that  particular  internship  throughout  the 
pro£^rani. 
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students  eould  be  assessed  ea  to  ^diat  step  they  oould  easily  accoasplish 
•Bd  their  internship  oould  be  the  next  step  in  this  sequence*   Also  students 
eouXd  rate  each  other  on  the  effectiveness  of  their  intervievdng  skills* 
This  internship  plan  has  the  following  advantages: 

1*  Having  students  practice  interviewing  oansf  role  models  and  going 
out  on  several  class  field  trips  will  expose  all  students  to  many 
jobs  other  than  the  one  they  are  exploring* 

2.    In  this  way*  the  students  and  teachers  ret  jive  a  more  general 

coverage  of  career  information.    It  also  breaks  down  job  stereotypes 
(jracialf  ethnic  and  sexual)  by  presenting  a  variety  of  role  models* 

3*  This  exposure  also  serves  as  a  sjotivator  to  students  to  work  hard 

for  an  individual  internship. 
km   Having  role  models  come  in  to  the  school  gives  parents  a  chance  to 

participate  in  the  program* 
%   M.9  model  visits  could  be  shared  with  other  classes  not  in  the 

CAST  pxogram*    This  mi^t  encourage  other  teachers  to  get  involved. 

Size  of  Group 

The  fldlze  of  the  internship  group  should  be  from  three  to  six*    It  was 
found  that  in  groups  smaller  than  three,  students  were  reluctant  to  ask 
questions*    In  larger  groups,  all  students  could  not  get  the  opportunity  to 
practice  asking  their  questions.    Some  employers  prefer  a  larger  group 
because  it  appears  more  efficient*   However,  employees  need  to  understand 
the  difference  between  a  field  trip  (idiich  is  what  most  of  then  are  acc\ts- 
tomed  to)  and  an  internship. 

Teacher  ParticiToant  on  Internship 

There  was  a  definite  split  on  the  participants*  feelings  towards  their 
involvement  in  the  actual  internships*   Some  felt  that  they  had  no  business 
on  the  internship  because  that  wotild  take  away  from  the  student  in  that 
the  employer  would  tend  to  address  his/her  remarks  to  the  teacher  and  not  to 
the  student.   Some  felt  that  it  was  important  to  the  student  to  do  this  "on 
their  own".    The  other  teachers  felt  that  the  following  were  definite  benefits 
to  their  participation: 

1.    They  could  "get  a  feeling"  for  what  their  students  were  experiencing 
so  that  they  could  better  understand  the  student's  feelings  regarding 
the  internships. 
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2.   It  would  give  them  an  opportunity-  to  evaluate  the  employer* 
3*    They  could  evaluate  bow  well  their  students  asked  questions. 
km   They  could  guide  students*  questioning,  lAere  necessary.    If  a 
parent  or  other  adult  supervisor  is  used,  he/she  should  be 
prepared  as  to  vhat  their  responsibilities  should  be. 

5.  They  could  evaluate  how  well  their  students*  questions  %rere  answered. 

6.  They  could  help  students  interpret  the  infosioation  in  relationship 
to  their  values. 

7.  They  could  help  students  discrininate  between  the  job  and  personality 
of  the  eoployer. 


Teacher  Selection  of  Internships 

Teachers  should  decide  what  kind  of  internship  would  be  ol  't  appropriate 
for  their  grade  level.   At  the  early  grade  level,  CAST  teachers  used  parents 
and  role  models  as  internships  within  the  school.   At  the  junior  high  level, 
most  of  the  students  went  out  on  internships. 

Teachers  should  decide  how  many  internships  they  want  and  how  many 
times  throughout  the  yea    they  want  to  schedule  them.    CAST  teachers  could 
only  schedule  one  internship  for  each  student,  but  it  was  recommended  that 
students  have  as  many  internship  or  interview  experiences  as  possible. 

Parent  Involvement 

A  Parent  Involvement  program  was  hi£^y  recommended.    This  would  begin 
at  the  start  of  the  CAST  program.   Suggestions  for  such  a  program  may  be 
found  in  the      '  ^-'-'^  '  ^  " 


Conclusions 

The  internship  component  is  the  "placement"  step  in  the  CAST  program. 
It  provides  the  students  an  opportunity  to  test  out  their  understanding  of 
themselves  and  the  job  which  they  have  been  exploring  in  a  realistic  setting. 
Reevaluating  the  information  gained  from  this  internship  experience  's  the 
point  at  which  the  recycling  process  of  expanding,  narrowing  and  preparing 
begins  again. 

Without  the  internship  the  CAST  program  would  be  only  a  cognitive 
exercise.    Therefore,  it  is  criticed  that  the  internship  program  be  well 
planned  and  organized  so  that  all  students  receive  maximum  benefit  from  their 
experience. 


Computer  Assisted  Occupational  Search 


Purpose 

Before  coinr  on  their  internships,  it  was  reco£:ni?.ed  that  students  need 
help  in  explorinr  their  interests  and  in  expanding  jobs*    It  was  decided  an 
interef?t  or  occupational  nurvey  might  be  an  interesting  technique  to  use 
with  CAST  student?^  in  helping  expand  their  information  base  before  bofinning; 
to  narrow.    Aftor  looking  at  several  occupational  surveys,  it  was  decided 
to  use  Dr.  John  Holland's "Self  Directed  Search."  (Holland  -  1970)  since 
1.    it  could  easily  be  computerized  for  ease  of  scoring, 
?•    if  computerized,  it  could  be  administered  in  half  an  hour, 
3*    it  related  activities,  interests  and  self  estimates  to  job 
alternatives,  v;hich  paralleled  the  CAST  program,  and 
it  could  be  modified  to  use  with  junior  high  school  students^ 
Dr.  Holland  was  contacted  ar!^]  permission  granted  to  use  the  instrument. 
(See  Appendix  C) 

One  purpose  of  the  "Self  Directed  Search"  is  to  help  students  explore 
their  interests  and  abilities  in  relationship  to  workers  who  have  the  same 
abilities  and  interests*    Having  to  respond  to  the  questions  helps  students 
look  at  specific  activities  which  they  like  and  competencies  in  which  they 
excell.    It  also  helps  students  become  aware  of  the  discrepancies  between 
their  interests  and  abilities. 

Another  purpose  is  to  provide  the  students  with  a  list  of  jobs  which 
they  can  use  as  a  basis  for  further  exploration.    The  link  between  students' 
interests  and  their  list  of  jobs  is  a  job  code.    The  job  code  is  based  on 
six  job  personality  types  -  realistic,  investigative,  artistic,  social,  enter- 
tjrising  and  conventional.    All  jobs  included  in  the  job  bank  are  described 
by  a  three  letter  code  combination.    For  example,  the  code  BSC  for  salesman 
rrcans  that  salesmen  resenble  people  in  Enterprising  occupations  most  of  all, 
that  they  resenble  people  in  Social  occupations  somewhat  less  and  people  in 
Conventional  occupations  still  less#    In  this  way,  the  code  provides  a  brief 
summary  of  what  au  occupation  is  like  by  showing  it^s  degree  of  resemblance 
to  three  occupational  groups. 
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Outcomes  and  Recommendations 


The  first  stop  in  exploring  Self  Directed  Search'*  was  to  have  a  i:roup 

of  junior  hi^h  teachers  and  counselors  raad  the  inventory  and  make  recommenda- 
tions for  chani:©^*    Tlieir  firr>t  sucGestion  was  to  simplify  the  directions  and 
so-e  of  tho  vuoabulary  words,  so  that  they  would  be  understandable  to  junior 
hich  students*    Secondly^  they  recommended  eliminating  the  students*  mathemat- 
ical computation  section  and  to  program  the  computer  to  compute  the  job  code* 
Thirdly,  they  recommended  including  a  section  in  which  students  could  indi- 
c^^te  their  best  liked  interest  area  and  educational  level  explored  in  the 
CAST  procran.    This  job  classification  system  is  taken  from  the  book  The 
Psycholofry  of  Occupations  (Roe  I956) 

The  above  changes  were  made  and  the  revised  "Search'^i  now  called 
Computer  Assisted  Occupational  Search  (CADS)  -  (See  Appendix  ^)  was  piloted 
with  a  ^;roup  of  8th  r;rade  students.    During  the  pilot,  the  students  had 
problems  in  the  following  areas: 

1.  Understanding  the  format  of  the  pages. 

2.  Understanding  the  directions  in  the  Self  Estimate  section. 

3.  /iderstanding  some  of  the  activity  and  job  title  terms. 
As  a  result  of  the  pilot,  Mr.  Stuart  Packard,  Assistant  Director 1 

Field  Services,  initiated  the  following  changes  in  the  CAOS  Inventory: 

1.  The  format  was  simplified  by  having  students  indicate  only 
positive  responses  to  a  question.    Having  two  response  boxes 
for  negative  and  positive  answers  confused  the  students. 

2.  Tho  directions  in  the  Self  Estimate  section  were  clarifiedf 

so  thf^t  the  students  would  understand  that  they  were  evaluating 
themselves  in  relationship  to  particular  job  skills. 

3.  T:io  Self  Estimate  scale  was  changed  from  seven  points  to  five 
point?  plwe  zero.    Thus,  the  scale  was  kept  consistent  with 
the  five  point  scales  used  throughout  CAST. 

Tlie  activities  and  job  titles  were  clarified  using  synonymous 
teiTis. 

5.    Some  examples  were  changed  to  reflect  female  as  well  as  male 
interests  and  to  represent  a  broader  range  of  activities  and 
competencies  which  could  be  included  in  any  of  the  six  occupa- 
tional categories. 
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lu  additioTii  the  computer  output  was  changed  so  that  it: 

A)    printed  out  the  stuaents  job  code  and  all  the  jobs 
(with  educational  level)  fitting  under  that  cate/^oryi 
(Sxaniplc:    ECS  -  Enterprising i  Conventional,  Social) 
3)  chanced  the  job  code  to  provide  two  other  combinations 
of  the  same  code  (C3E)  (SEC)    and  printed  out  a  different 
sot  of  jobs  fitting  under  each  dil. Cerent  code  combination, 
and 

C)    printed  out  all  jobs  falling  under  the  interest  area 
and  educational  level  preferred  by  the  students* 
?•    ?.   use  CADC,         i'^adr^r  should  first  contact "5r*  John  Black 

at  Conf^ultinc  Ps:/chclogy  Press,  577  College  Avenue,  Palo  Aitu, 
Californi.-\  9'^306. 


Pilot 

With  these  final  revisions,  CADS  and  the   non-coraputerised  versiont  -TJhe  Self 
Directed  Search^*,  were  piloted  with  two  groups  of  25  nineth  grade  students, 
who  had  been  through  the  CAST  program*    Both  teachers  read  the  instructions 
to  the  students,  ^avo  the  students  as  much  time  as  they  needed  and  answered 
all  their  questions. 

Tl-xe  group  using  CAOS  completed  the  survey  in  a  half  hour  and  had  no 
que;3tionc  concerning  directions  or  vocabulary*    The  other  group  took  two 
hours  to  cunplete  the  survey  and  encountered  numerous  problems  with  the 
directions  and  the  vocabulary*    Tlie  teachers  observed  that  the  math  com- 
putations in  the  manual  version  took  the  longest  and  were  the  most  confusing 
for  the  students*    In  the  computerized  version  the  math  computations  were 
handled  by  tlic  computer* 

The  ntudents  using  t!;*'^  manual  vr-rsion  had  to  look  up  and  write  down 
their  ov/n  jobr?  v/hile  the  students  using  the  computerised  version  received 
not  only  a  printout  of  jobs  related  to  their  job  code  but  also  received  a 
'•CASr»  classification  of  the  job  titles  as  they  related  to  their  highest 
interest  a       and  educational  level.    Although  the  students  using  the 
computor^r.ed  CAGS  had  to  wait  a  day  for  their  printout  list  of  jobs  the 
computerin:ed  sheet  served  as  a  motivating  factor  and  a  concrete  example 
of  jobs  they  should  be  exploring* 
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Conclusiona 


From  the  various  evaluations  of  the  computeriaeO  '^Self  Directed  Search*^ 
the  following  conclusions  were  drawn: 

1.  The  students  can  complete  the  inventory  in  ?  *4th  of  the 
time  it  takes  to  complete  the  manual  version** 

2.  The  printout  has  the  jobs  grouped  using  the  same  clfi*ssifi- 
ration  system  as  the  CAST  program, 

3*    Students  are  exposed  to  twice  as  many  jobs  as  they  would  be 
on  their  ov;n. 

4,    Computerized  CAOS  serves  as  a  unique  expanding  tool  and 
motivating  tool. 

5*    Students  can  relate  their  values  which  they  indicated  by  their 
CAOS  responses  to  their  values  identified  in  the  CAST  program. 

6.    Students  can  access  many  written  career  sources  through  the 
DOT*  numo^r  provided  in  CAOS  printout* 

?•    Students  can  take  their  printout  home  and  discuss  it  with 
their  parents. 

8.    Students  iearn  about  job  titles  with  which  they  are  not 
familiar. 

9*    Students  explore  themselves  as  they  answer  the  questions. 
10.    Students  le..  :n  about  each  others  interests* 

Here  are  a  few  suggestions  for  the  use  of  CAOS  with  or  without  the  CAST 
prof^ram. 

Without  the  CAST  pro^^rnm 

1)    Introductory  device  for  a  career  education  program. 

?)    Used  with  a  unit  on  values. 

5)    Used  to  be£;in  a  class  discussion  on  jobs* 

^)    Uf^cd  to  access  other  career  information. 
With  the  CAST  program 

1)  Used  to  expand  jobs, 

2)  Used  to  reference  information  sources  using  the  DOT 
classification  number. 

•Dictionary  of  Occupational  Titles  I965 
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5)    Used  to  expand  values. 

U)    Used  tc  coMpare  internship  decision  with  oricinal 

printout  list. 

5)  Used  bo  fore  and  after  CAST  and  comparison  made. 

6)  Exp-nn^  cHvareneps  of  interest  based  on  the  job  code  cateeories. 

These  are  only  a  few  ways  in  which  CADS  can  be  used  with  or  without  the 
CAST  program.  It  is  a  valuable  exploration  and  expanding  tool  and  is  highly 
recommended  for  use  in  the  program. 
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PaOQRAM  EVALUATION 


This  section  includes  all  of  the  fornjative  and  sununative 
data  collected,  analyzed  and  interpreted  in  this  project.  It 
specifically  addresses  the  followings 

1.  Introduction  to  the  Research  Report 

2.  Evaluation  of  the  Objectives 

3.  Other  Information  gathered  relating 
to  the  objectives 

4«    Outcomes  and  Recommendations 
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Introduction 


Description  of  Report 


The  following  report  is  not  an  evaluation  report  in  the  normal  sense. 
The  Pontiac  Hesearch  and  Development  department  did  not  serve  as  the  formal 
evaluators  of  this  project.    Their  primary  function  was  that  of  consultants 
and  data  analyzers.    This  consisted  of  pre/post  analyses,  teacher  and  stu- 
dent reliability  checks  and  correlations  studies  between  the  subgroups.  A 
description  of  the  role  of  the  external  evaluator  is  described  in  Appendix  F. 

The  analysis  procedures  described  in  this  report  were  decided  and  agreed 
upon  by  the  external  evaluator  and  the  Pontiac  Research  and  Develop- 
ment staff  along  with  the  Project  Director. 

The  project  Director,  Judy  Battenschlag,  was  the  primary  determiner  of 
the  evaluation  dosign  and  also  did  the  data  collection.    Instrument a  were 
supplied  by  the  consultant  firm  or  were  authored  by  the  project  director. 
The  only  exception  is  the  curriculum/project  evaluation  form,  which  was 
supplied  by  the  Pontiac  Research  and  Development  department. 

For  detailed  description  of  the  instruments  and  scoring  procedures, 
refer  to  the  body  of  the  project  report. 

The  report  format  is  divided  into  three  parts. 
Evaluation  of  Objectives 

1.  Objective  1  -  Student  Data 

2.  Objective  2  -  Teacher  Data 

3.  Objective  5  -  1972-73  Trainees 
k.    Objective  k  -  Training  Data 

5.  Objective  5  -  AIDS 

6.  Objective  6  -  GADS 
Other  Information 

7.  Curriculum  Evaluation 

8.  Attitude  Data 

9.  Scoring  and  Soo^-or  Rfl 'ability  Procedures 

10.  PALS  Evaluation 

11.  Other  Questions 
Summary 

Sections  1-6  pertain  to  data  which  describe  the  outcomes  of  CAST 
objectives  1-6.    Since  the  curriculum  was  a  major  outcome  of  the  project,  an 
attempt  was  made  to  assess  its  useability  and  compare  it  to  other  curricula  that 
the  participants  have  used  previously.    The  results  are  reported  in  Section  7. 
Section  8  is  comprised  of  data  collected  to  assess  attitudes  of  parents,  teachers 
and  students  toward  involvement  in  CAST. 

5?) 


Many  of  the  instruments  used  to  assess  the  levels  of  functioning  of 
students  and  teachers  in  CAST  were  newly  developed.    Therefore,  reliability 
measures  were  unavailable.    The  Pontiac  R  and  D  department  devised  means  to 
determine  instrumental  and  scorer  reliability.    The  results  of  these  checks 

are  found  in  Section  9» 

Pontiac  Adult-Student  Learning  Systems,  while  not  funded  by  CAST,  was 
an  extension  of  the  original  program  into  the  high  school.    The  director 
and  the  two  instructional  leaders  were  participants  in  the  original  CAST 
in-service  and  served  as  trainers  for  the  second  in-service.    Because  of 
the  close  involvement  with  CAST,  a  copy  of  the  PALS  report  is  included  in 
Section  10. 

Several  questions  were  addressed,  which  were  not  part  of,  but  were 
felt  to  bo  related  to,  the  initial  stated  objectives.    Outcomes  of  the 
research  done  on  these  issues  is  addressed  in  Section  11.  Finally, 
the  Outcomes  and  Recommendations  Section  concludes  the  PB0C5RAM  EVALUATION 
SECTION. 
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Svaluation  of  Objectivea 
Objective  One  -  Student  Data 

OBJ^IVS  ONE  -  On*  husdrwl  tventj-flve  olttMatary,  TOO 
Junior  Hlc^  and  200  Mi^  School  students  will  deoonstrats 
knowledge  of  career  aehieveaent  skills  neoessary  for 
career  placesent  during  the  1973-7<f  school  year. 

Students  Selected 

Eleaentary  -  EbcperiBental 

Only  t%fo  first  grade  classes  were  innrolved  in  the  eleaentary  portion  of 
the  project  because:   1)  the  other  selected  eleaentary  teachers  were  unable 
to  participate  in  the  suaner  training  sessions «  and  2)  the  eleaentary 
teachers  involved  last  year  were  unable  to  schedule  the  CAST  px^grao  because 
of  major  curriculum  changes  in  their  schools* 

SLeaentary  -  Control 
No  control  group  was  used  because  of  the  technical  nature  of  the  CAST 
skins. 

Junior  Bifdn  -  toerimental 
All  tut  one  of  the  CAST  teachers  selected  one  of  their  classes  at  rasdoa 
to  receive  CAST  instruction.   The  other  teacher  was  a  ninth  grade  instructor 
who  had  been  in  the  prognja  last  year  and  taught  CAST  as  a  10-week  olni-course 
to  students  who  elected  it* 

Junior  Hiflh  -  Control 
One  control  group  was  selected  at  randoo  fton  ons  seventh,  one  wi^th 
and  one  ninth  grade  school* 

High  School  -  aroeriaental 

There  were  a  snail  nuaber  of  hi^  school  personnel  intertotad  la  applying 
for  the  CAST  project.  Only  two  high  school  teachers  were  <*i4*<ti7iy  sslected 
to  be  involved  in  the  project.   Of  the  two  selectedt  one  aoTed  out  of  the 
district.   Thus,  only  ons  class  was  involved  at  ths  hig^  school  lertl* 

Although  the  intention  was  to  eaepand  the  CAST  projact  into  tha  hig^  sdiodl 
this  year,  a  new  project  called  PALS  (Pontiac  Adult-Student  Leandag  Systea) 
was  ftmded  for  the  purpose  of  extending  the  career  skills,  the  interpexooaal 
cooBunication  skills  and  the  internship  experience  into  the  high  school*  The 
results  of  this  extension  of  the  CAST  project  can  be  found  ia  ike  loatiae  Adalt- 
Student  Learaiag  SyetM  lateria  Bepert«  (^Tiae  ISt^) 
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High  School  -  Control 


No  control  group  was  used  at  the  high  school  because  of  the  small  number 
of  students* 

Instruments 

Module  Testing  -  Scoring  Criteria 
Nine  modular  test  questions  were  written  to  cover  a  given  number  of  CAST 
performance  objectives.    (See  Appendix  Q)  Each  question  was  scored  on  a 
five-point  scale  with  level  three  being  defined  as  mastery  level •    See  ^he 
following  page  for  scoring  description. 

Scoring  Procedure 

Each  teacher  administered  the  module  test  after  completing  the  perfor- 
mance objectives  within  that  module*    After  giving  the  testi  each  teacher 
scored  his/her  own  tests  according  to  the  described  scoring  criteria*  (Each 
teacher  had  been  trained  to  score  on  sample  tests* )    A  modular  test  record 
was  kept  by  each  student  as  well  as  the  teacher. 

Each  teacher  followed  this  testing  procedure  until  time  ran  short* 
First  the  one  high  school  class  was  finished  at  the  end  of  the  first  semester* 
The  teacher  had  to  stop  the  modular  testing  in  order  to  come  close  to  finishing 
the  program  in  a  semester's  time*    Another  teacher  at  the  junior  high  ran 
into  the  same  problem  in  trying  to  deliver  the  program  in  a  semester* 

The  major  problem  for  teachers  was  scheduling  enough  time  to  deliver 
all  the  CAST  objectives «  administer  the  modtilar  tests  which  took  one  class 
period,  and  teach  their  regular  course  content.    Because  the  tests  paralleled 
so  closely  the  daily  performance  objectivesf  it  was  decided  to  create  «  final 
summary  test  question  which  would  cover  the  entire  course  and  thus  cut  down 
on  the  time  needed  for  modular  testing. 

Summary  Question  -  Description 
The  final  sximmary  question  asked  students  to  describe  and  give  examples 
of  the  steps  they  would  take  in  developing  a  career  plan.    (See  Appendix  H) 

The  intent  was  to  have  students  apply  the  skills  the^  had  learned  in  develop- 
ing a  sequential  career  plan. 

er|c  » 


Due  to  program  revision  and  time  constraints  goals  3  (choosirig  a  limited 
set  of  occupations  to  explore),  11  (identifying  specific  skills  through 
personal  interview),  12  (evaluating  oneself  in  relation  to  the  job  require- 
ments), Ik  (investigating  principles  that  relate  performance  to  goals  to 
human  benefit),  and  17  (investigating  Job  with  regard  to  promotional  poss- 
ibilities) were  not  addressed  to  the  degree  that  they  were  testable. 
Goals  15  (reevaluating  job  with  regard  to  new  information)  and  l6  (reeval- 
uating occupation  with  regard  to  change  of  values)  while  included  in  the 
evaluation  were  not  addressed  equally  by  all  teachers. 

Scoring  Criteria 

Each  skill  area  evaluated  included  ons  or  more  of  the  CAST  curriculum 
goals.    (See  Appendix  I  for  CAST  Curriculum  Goals  and  Summary  Question 
Scoring  Matrix) 

Each  skill  area  is  evaluated  on  a  five-point  scale  with  the  general 
discrimination  given  at  the  bottom  of  the  scoring  matrix.    If  students 
didn^t  answer,  an  implied  answer,  or  showed  a  model  or  scheme  used  to 
answer  the  question  they  would  get  a  2.    If  they  gave  at  least  two 
explicit  examples,  they  got  a  3  which  is  mastery.    If  they  gave  examples 
and  showed  a  scheme  or  system*  in  answering  the  question,  they  would  get  a  km 
If  they  had  all  the  steps  in  order  they  would  receive  a  5* 

Scoring  Pl^ocedure 

The  tests  were  administered  in  two  one-hour  blocks  by  the  CAST  teacher 
and  in  one-hour  blocks  by  the  control  teacher.     The  control  students  were 
finished  way  before  the  hour  was  over» 

These  tests  were  then  scored  by  six  of  the  CAST  trainers  after  being 
trained  by  the  Project  Director  to  use  the  scoring  criteria.    Each  trainer 
would  score  four  tests  from  one  teacher  and  then  wotild  score  four  from 
another,  etc.    Thust  each  trainer  had  a  chance  to  score  tests  from  all 
experimental  and  control  groups. 

ELementar;y  Testing  Procedure 
At  the  elementary  level  each  student  in  the  two  experimental  first  grade 
classes  were  tested  (at  the  end  of  the  year)  individually  on  the  test  questions 
listed  on  the  chart  on  the  following  page.    If  the  student  answered  the  question 
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correctly,  a  check  was  given.    If  the  student  missed  the  question,  no  mark 
was  given.    This  chart  indicates  the  percent  of  children  answering  the 
questions  correctly  as  compared  to  the  rest  of  the  children  in  that  class. 
Then  the  scores  for  both  classes  were  combined  and  the  total  percentage 
calculated. 
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Elementary 


DiscuaBion  of  D^ta 

Although  Claasea  I  and  II  were  very  cloae  in  their  achievenenti  on 
questions  7-8  regarding  "thing  information"  aourcea  and  question  words* 
Class  I  did  not  perform  as  well  as  Class  !!•    In  talking  to  the  teacher 
it  was  found  that  as  much  time  was  spent  on  instruction  in  these  areas 
as  did  the  other  teacher. 

Both  classes  scored  highest  on  the  expanding  questions  1,  2,  5  and 
6.    Expanding  or  generating  job  titles  seems  to  be  easier  for  students 
than  classifying  jobs  in  people  and  thing  categories  which  is  a  higher 
order  cognitive  process. 

In  regards  to  question  3»  students  seem  to  be  able  to  discriminate 
easier  between  an  indoor  and  outdoor  job  as  opposed  to  a  people  and  thing 
job.    Perhaps  the  discriminations  given  by  the  teachers  were  more  definitive 
for  indoor  and  outdoor  as  opposed  to  people  and  things. 

The  scoring  was  higher  on  question  6,  generating  people  sources,  as 
opposed  to  question  7,  generating  thing  jsources.    One  explanation  is  that 
more  time  was  spent  exploring  people  sources  than  thing  sources  because 
of  the  reading  level  and  interest  areas  of  the  children. 

On  the  program  development  questions  10,  11,  12  the  children  did 
extremely  well.    The  children  seemed  to  find  it  easy  to  look  at  a  behavior 
and  break  it  down  into  smaller  behavioral  steps  and  sequence  them  so  as  to 
reach  the  goal  or  objective.    This  skill  is  the  basis  for  preparing  or 
planning  ceo'eer  programs  or  sequencing  behavior  to  reach  goals  of  varying 
complexity. 

Conclusion 

As  can  be  seen  from  this  data,  elementary  children  can  learn  career 
achievement  skills  simplified  for  their  readiness  level.    In  cases  where  they 
scored  lew  they  either  lacked  experience,  exposure  )r  practice. 

Only  the  expanding  and  preparing  skills  were  measured  because  they  were 
the  only  skills  emphasized  at  this  age  level.    Perhaps  in  the  future  the 
decision  making  skills  could  be  looked  at  and  simplified  for  their  level. 
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Diacussion  of  Data 

1*    Module  Ti$8ting  -  These  tests  were  designed  to  be  administered  at 
the  completion  of  each  ourriculua  Bodule.    In  cost  cases  it  con- 
sisted of  an  observational  checklist  idUch  the  teacher  checked  to 
see  if  the  students  vere  able  to  cosplete  the  objective.  Scoring 
procedures  were  predetermined  and  involved  a  ^-point  scale  ranging 
from  1  to  5  (low  to  high)  with  a  value  of  3  being  acceptable. 

Due  to  clerical  and  bookkeeping  problems,  it  becm  a  burden 
for  the  teachers  to  maintain  the  data  collection  procedures  at  the 
end  of  each  module.    Of  the  firs^  12  modules,  3^  of  the  data  was 
turned  in.    Of  the  total  20  modules,  529$  of  the  data  was  available 
for  analysis. 

With  frhis  amount  of  missing  data,  it  is  not  good  practice  to 
attempt  to  generalise  to  the  population.    Therefore,  the  only 
reporting  is  of  the  first  12  modules  and  the  percent  of  students 
receiving  a  score  of  3  cr  above  in  each  class. 
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Final  Testing  -  A  total  of  ten  taachara  administered  a  poat  teat i 
three  of  whom  were  control  teachera  (see  Table  A). 

Table  B,  ia  a  compariaon,  by  objective*  of  experimental  to 
control  in  terms  of  percent  of  atudenta  achieving  an  acceptable 
performance,  i.e.,  level  three  on  a  five-point  scale. 

Table  C  is  a  comparison  of  experimental  to  control  in  terms  of 
the  major  curriculum  con^nents  of  CAST. 

Both  Table  B  and  C  clearly  illustrate  that  the  experimental 
groupa  did  out -perform  the  control  groupa.    However,  an  interesting 
result  is  the  relatively  high  performance  of  the  control  group  on  skill 
area  8,  which  tested  the  loarner'e  ability  to  write  a  step-by-atep 
program  to  reach  a  goal. 
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Experiaental 
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TABI£  D 
STUSENT  PSRFOBMANGS  SBOFXLB 
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Table  D  ia  a  profile  of  student  performance  and  illustrates  the 
general  tendency  of  both  the  experimental  and  control  groups  to 
decline  on  the  items  which  covered  the  material  delivered  toward 
the  end  of  the  CAST  program  (with  the  exception  of  skill  area  8,  control). 
Perhaps  this  decline  was  due  to  the  increasing  difficulty  of  the  objectives 
or  to  the  closeness  of  the  later  objectives  to  the  end  of  the  delivery 
time  period;  or,  perhaps  the  decline  is  due  to  a  combination  of  these 
and  other  factors  such  as  unequal  treatment  of  skill  area  9  by  all  teachers. 
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TABLE  E 

COMPARiaON  OF  TOTAL  PEBFOBKANGE 


7.6 


92.4 


Experimental  Control 

^IP    Percent  Accomplished 
(3    Percent  Not  Accomplished 

Table  E  represents  a  comparison  of  the  performances  of  experimental 
and  control  students  on  the  total  CAST  program. 

Conclusion 

As  can  be  seen  from  examining  the  previous  charts  and  graphs*  there  is 
an  obvious  difference  betwem  the  experimental  and  the  non<-treated  control 
group.    Students  did  learn  career  skills  as  a  result  of  instruction  by  CAST 
trained  teachers.    On  overall  performance,  6k%  or  about  2/3  of  the  objectives 
were  achieved  at  an  acceptable  level. 
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Ob.lectir.  Two  -  ftMh»r  Pat.  ^  jq„  f^ij^y^ 

Objective  Two    •        I97>-7^  tmlMM  ^11  AMutmtt 
teovI«dt«  of  iat«iv«raM«I  ■klUs«  •tecatlMMl  lUlla 

Teacher  Selection  Inventory 

AdBunistemtion 

The  Hunan,  Educational  and  Career  Xurentorleo  were  given  as  selection 
derices  before  the  August  training  and  then  again  at  the  end  of  the  pTOgran 
in  May.   The  trainers  ••pre"  inventories  were  those  given  for  their  Initial 
selection  in  1972.   They  also  took  the  post  Inventory  in  Nay*   All  partici- 
pants had  uzaiiBited  tioe  to  taka  the  Inventories. 

Huttan  -  Deecription 
A  Human  Sesource  Development  Inventory  (see  i^pendix  J)  developed  by 
Carkhuff  Associates  to  measure  Human  (Interpersonal)  and  Sducational  Skills 
was  used  as  one  criterion  in  selecting  teachers  and  counselors  for  participation 
in  the  CAST  program.    The  inventory  has  two  parts.    The  first  part  deals  with 
the  two  basic  human  achievement  skills  defined  by  Carkhuff  as  communication 
(inter-action  skills)  and  discrimination  skills  (perceiving  likes  and  differences). 

The  cofflaninioation  iteas  consisted  of  a  stlHulus  oipresslon  In  the  fonn 
of  a  short  academic  or  personal  prohleai  as  stated  by  a  student  to  tdiioh  the 
"trainee",  the  teacher  or  counselor  oust  respond  by  writing  their  aost 
helpm  response  as  if  they  were  talking  to  the  studeat.   These  responses 
are  then  assessed  as  to  their  level  of  effectiveness  on  a  scale  froa  one- 
five.   One  is  the  least  effective  and  five  is  the  oost  effective  response 
in  coooMnicating  to  a  person. 

In  regard  to  the  dlsorisdnation  iteos,  the  trainees  were  presented  with 
a  student  stiaulus  expression  of  an  acadeoic  or  personal  proULen  sad  w«re 
then  presented  with  five  possible  r  iponses.   They  were  then  to  rate  these 
responses  in  terns  of  their  effectiveness  on  the  saae  one-five  soale  as 
mentioned  above.   Both  :!lve-pelnt  scales  can  be  found  In  The  Art  of  TTffi^h'***ff« 
by  Or.  Bobert  R.  Carldmff «  Dr.  David  B.  Bereasea  and  Dr.  Siebard  N.  Fleree. 

Bducatlonal  Deacrlptlon 
The  educational  part  of  the  inventory  (aae  Appendix  K)  asked  for  a  free 
response  to  the  statement «  '^Develop  a  lesson  plan  you  would  deliver  tofflsrrov.** 
The  response  was  assessed  on  the  critical  skill  dimensions  of  teaching  preparation 

and  delivery  as  described  by  Dr.  Robert  Carkhuff  and  Dr*  Bavid  Berenson  in  their 
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book,  The  Art  of  Teaching*    These  skill  dimensiona  are  -  objective-evaluation, 
currictilum  development  ,  teaching  methods «  classroom  management  and  RDPES 
(review,  observe,  prepare,  exercise,  summarise).    These  skill  dimensions  are 
also  rated  on  a  cne-five  scale  of  effectiveness  %fhich  can  be  found  in  the 
book  previously  mentioned.  The  Art  of  Teaching.  (Carkhuff ,  Berenson,  Pierce 
197^) 

Educational  -  Scoring  Criteria 
Each  teacher  was  rated  on  a  5-point  scale  in  each  of  the  areas  listed 
on  the  next  page.    Frequencies  were  tallied  and  a  mean  score  was  calculated 
for  the  curriciilum  development,  teaching  methodology  and  classroom  management 
areas.    The  objective-evaluation  and  BDEBS  areas  were  given  only  one  rating 
because  only  one  rating  for  each  area  was  appropriate. 

Career 

Same  as  student  modular  testing  for  pre-test.    Same  as  student  final 
summary  question  for  past  test. 

Observational  Checklist 

Description 

The  observational  checklist  (see  Appendix  A)  was  used  to  observe  the 
teachers  on  the  skills  which  they  had  learned  during  the  summer  training. 
The  observations  were  recorded  in  the  time  frame  of  Review,  Overview,  Preview, 
Exercise,  Summary  (HOPES  -  see  '"Training  Component"  under  PHDOBAM  »fiSGEIPTa:N 
SECTION  for  a  description  of  HOPES)    Each  teacher  was  observed  and  her 
behavior  recorded  on  a  5-point  scale.    The  checklist  was  used  as  a  wa;;  of 
describing  teacher  behavior.    In  using  this  checklist,  we  were  making  the 
assumption  that  these  skills  make  up  effective  teaching  -  teaching  that 
results  in  student  growth.    What  we  were  sayir^,  is  that  effective  teachers! 

1)  use  a  greater  quality  and  quantity  of  methods, 

2)  actively  involve  the  students  in  the  learning  process, 

3)  teach  the  students  skills  and  a  way  to  evaluate  whether  or  not 
they  are  doing  the  skill  ri^t, 

k)  help  students  to  explore,  understand  and  act  on  their  understanding, 
^)    attend  to  students, 

6)  respond  to  students  expressed  ideas  and  feelings,  and 

7)  differentially  reinforce  student  behavior  in  relationship  to  student 
behaviorial  goals. 
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For  a  more  detailed  description  of  these  skills,  read  The  Art  of  Teaching. 
(Carkhuff,  Berenson,  Pierce  197^) 

Although  we  had  originally  intended  to  use  the  observational  check 
list  as  a  means  of  evaluating  teacher  performance  on  educational  delivery 
skills,  difficulty  in  standardizing  the  instrument  prevented  the  accumulation 
of  reliable  data  for  evaluation  purposes.    Because  we  continued  to  change 
and  improve  the  check  list  it  was  useful  in  helping  the  trainers  improve 
their  discrimination  in  increasing  the  quality  of  feedback  to  teacherrs 
for  improvement  in  their  delivery.    Because  the  instrument  was  in  the  process 
of  development  it  was  limited  in  its  use  as  an  ongoing  evaluation   tool  frc*i 
an  observational  standpoint.    However,  it  was  extremely  effective  as  an 
assessment  tool  for  teacher  feedback  and  growth. 

Scoring  Criteria 

The  five-point  scale  used  to  observe  each  skill  area  ranged  from  1  - 
least;  effective  to  5  -  most  effective  in  terms  of  overall  student  learning. 
At  this  time  we  are  still  in  the  process  of  describing  vhat  is  the  optimal 
teacher  modal  and  t    ,i  rating  in  each  area.    We  were  attempting  to  describe 
teacher  "profiles"  and  Iook  at  them  in  terms  of  student  outcomes. 

Scoring  Procedure 

Bach  trainer  observed  their  trainees  throughout  the  year.    During  the 
last  three  weeks  of  the  program,  the  trainers  observed,  rated  and  taped  the 
trainees  for  the  final  evaluation.    Each  teachar  f  .put  was  recorded  in  the 
appropriate  box  for  the  appropriate  skill.    Then  a  modal  and  mean  score  was 
calculated  for  each  skill  area. 
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Diecttseion  of  Data 

The  teachers  were  adoinistered  the  conaulcant  supplied  paper/pencil  tests 
at  the  beginning  of  the  program  to  isesaure  skill  level  in  interpersonal  and 
educational  skills.    A  description  of  the  instruments  is  included  in  the 
body  of  this  report. 


Pre 


Post 


Intemersonal  Skills 

Educational  Skills 

s.d. 

X 

s.d. 

16 

6.02 

83.9 

22.3 

^1.2 

3.12 

166 

M3.6 

For  the  data  on  interpersonal  skills,  the  difference  bet%#een  pre  and 
post  yields  a  dependent  t  of  19.83  indicating  a  significant  increase  in 
performance  at  the  #001  level. 

The  conrelation  between  pre  and  post  was  r  m  A3t  vith  a  dependent 
t  of  7.11  indicating  a  significant  growth  at  the  .001  level. 

Although  data  on  career  eskiUs  is  available,  the  pre  data  was  collected 
using  a  different  instrument.    Therefore,  the  only  comparison  data  is  with 
student  performance  and  that  is  discussed  later  in  this  report.    Based  on 
a  possible  score  of  4^,  the  mean  performance  of  the  teachers  wftis  37.33  with 
a  s.d.  of  7.76. 

Conclusion 

The  assumption  can  safely  be  made  that  the  tradnees  did  acquire  those 
skills  which  were  necessary  to  the  delivery  of  the  CAST  program. 
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Discussion  of  Data 


Bie  teachers  were  administered  the  consultant  supplied  paper/pencil  tests 
at  the  beginning  of  the  program  to  measure  skill  level  in  interpersonal  and 
educational  skills.    A  description  of  the  instruments  is  included  in  the 
body  of  this  report. 


Intemersonal  Skills 

I  Educational  Skills 

X 

s.d. 

X 

s.d. 

16 

6.02 

22.3 

^1.2 

3.12 

166 

to.6 

For  the  data  on  interpersonal  skills,  the  difference  between  pre  and 
post  yields  a  dependent  t  of  19.83  indicating  a  significant  increase  in 
performance  at  the  .001  level. 

The  correlation  between  pre  and  post  was  r  »  A^f  with  a  dependent 
t  of  7.11  indicating  a  significant  growth  at  the  .001  level. 

Although  data  on  career  skills  is  available,  the  pre  data  was  collected 
using  a  different  instrument.    Therefore,  the  only  comparison  data  is  with 
student  perfozmance  and  that  is  discussed  later  in  this  report.    Based  on 
a  possible  score  of  43,  the  mean  performance  of  the  teachers  was  37*33  with 
a  s.d.  of  7.76. 

Conclusion 

Ttie  assumption  can  safely  be  made  that  the  trainees  did  acquire  those 
skills  which  were  necessary  to  the  delivery  of  the  CAST  program. 
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Objective  Three  -  1972-73  Trainees 


OBJSCTZVS  TBBSB  -  1k«  1972*73  tralBMS  wiU  dMOiuitrat* 
kBowl«df«  of  •dneatioaal  tkillM  ostd  for  doIlTtxy  of 
tho  aod*!  Icmob  jIul  to  studrnts  daring  th«  seheol  j%t. 

It  MS  not  poMiULo  to  dollTor  on  this  objoetiTO  booanto  tho  ttaehors 
and  counaalora  could  not  ba  ralaasad  to  dalivar  tba  nadal  laaaon  plana. 
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Objective  Four  -  Training  Data 


BEST  COPY  AVAILABLE 


OBJSCnVE  FOUS  -  Ttir—  •ItarataxT  couiiB«lora,  ob« 
junior  higii  te»chtr,        ••aior  hi^  epuasalers  and 
t%M>  atelniatrators  will  oonduet  traialag  and  follow- 
up  ••Miona  in  imtarparaonal  akilla«  tdueational 
akilla  and  cartar  akilla  to  now  CAST  partieipanta 
during  tha  auaiar  and  tha  1973-7'^  aehool  yaar. 

The  above  personnel  were  traineaa  in  fhaaa  II  of  the  CAST  program. 
As  a  result  of  thoir  performance  and  their  availability  they  became  trainers 
in  Phase  III.    A  discussion  of  training  oethoda  used  and  tha  frequency  of 
training  can  be  found  in  the  "People  and  Training  Component'*  undar  the 
PROGRAM  DESCRIPTION  SECTION. 

Discussion  of  Data 

One  means  of  attempting  to  determine  the  achievement  of  Objective  4 
is  to  compare  the  pre/post  scores  on  the  interpereonal  and  educational 
skills  tests  as  a  function  of  growth.    If  the  trainers  described  in  the 
objective  did  deliver  the  training,  and  if  the  post  test  scores  were 
significantly  higher  than  the  pre-test  scores,  then  the  skills  were  acquired 
by  the  trainees  as  a  result  of  tredner  effort.    The  data  reported  in  dis- 
cussion of  Objective  2  supports  this  assumption.    Although  the  mean  s'^ores 
increased  in  both  interpersonal  skill  (Inc.  -  25.2)  and  educational  skills 
(Inc.  82.1),  there  appears  to  be  a  difference  in  the  distribution  of 
scores.    The  decrease  in  s.d.  (6.02  to  3.12)  between  pre/post  on  interper- 
sonal skills  as  measured  by  the  evaluation  instrument,  indicates  a  decrease  cf 
variation  in  performance  by  the  trainers.    The  increase  in  a.d.  (22.3  to  i*0,6) 
on  the  educational  skills  indicates  an  increase  in  the  variation  of  performance 
on  the  evaluation  instrument  revealing  differential  learning  on  the  part  of 
the  trainees.    Therefore,  while  interpersonal  skills  were  learned  equally 
well,  educational  skills  were  not  learned  equally  well.    If  the  learning  is 
a  function  of  the  delivery,  it  appears  that  \*iile  all  skills  were  delivered, 
some  were  delivered  more  adequately  than  others. 

In  order  to  determine  whether  or  not  this  objective  had  been  met  from 
the  teacher's  view  point,  a  questionnaire  was  developed  and  distributed  to 
the  1972-73  participants.    Nine  participants  returned  surveys.  Partici- 
pants were  asked  to  respond  to  questions  about  each  of  the  skills  delivered 
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in  terms  of  each  of  the  training  modes,  i.e.,  summer  training  (question  l), 
monthly  meetings  (question  2)  and  conferences  as  a  result  of  classroom 
observation  (question  3). 

Question  ^  was  asked  in  an  attempt  to  identify  skills  which  teachers 
felt  were  never  delivered  adequately.    Question  5  was  designed  to  identify 
skills  which  may  have  been  needed  which  were  not  provided. 

•Riere  was  also  a  question  concerning  the  usefulness  of  the  skills  to 
the  teacher  as  they  might  relate  to  other  than  the  delivery  of  CAST. 
Questions  ?♦  8,  and  9  were  designed  to  determine  this  issue. 

Questions  10,  11,  12  and  13  were  designed  to  determine  how  the  trainee 
evaluated  his  own  skill  level  and  his  need  for  further  training. 

Although  physical  skills  were  delivered  in  tha  training,  they  were 
not  included  in  the  objective.  Therefore,  the  results  are  not  reported 
here. 

To  summarize  the  data  as  it  relates  to  the  original  question,  335^ 
or  less  of  th'  teachers  felt  that  they  were  not  adequately  prepared  by 
the  training  in  only  two  of  the  thirteen  skill  areas  defined,  i.e.,  program 
development  and  learning  strategies.    All  other  skills  were  reported  by 
lOOSlo  of  the  trainees  as  having  been  delivered  during  some  training  phase 
at  a  level  which  prepared  them  to  deliver  the  CAST  program  to  their  stu- 
dents.   No  less  than  66%  of  all  respondants  reported  their  own  skill 
level  to  be  higher  at  the  end  of  the  summer  training  than  before  training 
on  12  of  t-.he  13  skills  in  question  and  669^  or  more  reported  an  additional 
skill  increase  between  August  and  the  end  of  the  project.    This  last 
report  included  the  two  skill  areas  which  were  previously  reported  by  some 
to  have  been  delivered  at  less  than  adequate  levels.    (This  increase  in 
skills  is  substantiated  by  the  data  from  Objective  2.) 
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CAST  Training  Skills  Svalxiation  Check  Liat 
Ycb/No  for  each  akill  (not  1-5  acoring) 

1.  This  akill  was  delivered  adequately  in  the  aummer  training. 

2.  Thia  akill  was  delivered  adequately  in  the  Wayne  State  Class. 

3.  As  a  result  of  the  observation,  the  trainers  assisted  me  in 
improving  this  skill. 

h»    This  skill  was  never  delivered  adequately. 

5.  I  needed  to  have  more  training  in  this  skill  in  order  to  de- 
liver CAST  effectively, 

6.  I  was  able  to  use  this  skill  In  my  career  delivery. 

7.  I  was  able  to  use  this  skill  in  my  regular  delivery. 

8.  I  have  been  able  to  use  the  akill  for  my  o%m  personal  growth. 

9.  I  have  been  able  to  teach  someone  else  (other  than  my  atudents) 
this  skill. 

10.  X  feel  that  I  could  teach  someone  else  this  skill. 

11.  I  would  like  additional  training  on  this  skill. 

12.  My  level  of  functioning  on  this  skill  was  hi^er  after  the 
August  training  than  before  the  Auguat  training. 

15.    My  level  of  functioning  on  this  skill  ia  liigher  now  than  it  was 
after  the  August  training. 
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CAST  SKILLS  TRAINING  ASSESSMENT 


100%  reoponded  yea 
66%  -  99%  responded  yes 


G3  33%  65%  responded  yes 
Q  0%  -  32%  responded  yes 

Traininp  Skills  Evaluation  Checklist 

Number  of  Statements 


Skills 


I.    Interpersonal  Skills 


A^    Attending  (1^5) 


Bm    Responding  (1-5) 


C*    Goal  Setting 


D*    PrograiD  Development 


II.  Educational  Skills 


A*    Lesson  Planning 
( ROPES / 


Teaching  Methods 
(T,S,D) 


C#    Learning  Strategies 
(EUa) 


D*    Content  Development 
(Facts  -  Prog#) 


E*    Classroom  Mgm't* 
(I-D) 


F*  Reinforcement 

III. Care  ^r  Skills 
A.  Expanding 


B.    Narrowing  (DM) 


O  J  Preparing 
ERJC     (Prog.  Dev.) 


An  attempt  was  made  to  determine  to  what  degree  that  the  level  of 
functioning  of  the  trainer  affected  performsuace  of  the  trainee.    First,  the 
data  used  for  this  attempt  was  the  post-test  data  on  intfe**personal  skills. 
The  mean  of  the  trainees  was         with  a  s.d.  of  3.1.    The  trainers  had  a 
corresponding  set  of  data,  kl.9  and  1.3.    The  correlation  between  the  two 
sets  of  scores  was  0.09,  N  =:  10.    The  variances  produced  by  this  instrument 
were  so  small  that  meaningful  correlations  are  difficult  to  obtain.  All 
that  can  honestly  be  derived  from  this  data  is  the  observation  that,  after 
training,  the  trainees  and  trainers  are  more  alike  than  they  were  before 
training  and  that  the  trainers  Cs.d.  1.5)  are  more  alike  than  are  the 
trainees  (s.d.  3.1). 

The  educational  data  revealed  a  similar  finding. 


i 

X 

trainees  • 

?«•? 

trainers  • 

199 

8.5 

The  correlation  (r)  =  -0.20 

The  low  variance  makes  statistically  significant  correlations  difficult 
if  not  impossible  to  obtain.    Before  the  question  of  trainer/trainee  rela- 
tionship cen  be  adequately  addressed,  more  complete  instrumentation  must  be 
developed  and  used  systematically  over  a  pre-determined  time  period. 

Conclusion 

Ttit  trainers  did  deliver  interpersonal,  educational  and  career  skills 
to  the  tri;.inees« 
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Objective  Five  -  AIDS 


Objective  Five  -  The  computer  will  be  used  to  analyze 
career  achievement  skills  test  results  during  the 
1975-7^  school  y«ar. 

AIDS  was  used  only  during  Phase  II  of  the  pro;«''>ct.    The  reason  it 
was  not  used  in  Phase  III  was  that  the  modular  and  CAST  Summary  Questions 
were  so  designed  as  to  not  require  computer  scoring.    (For  a  description 
of  AI'vS  see  Appendix  M) 

AIDS  is  not  included  in  the  Technical  Report  because  it  was  not 
developed  as  part  of  t     C^T  project.    It  was  sinply  adapted  for  use  in 
CAST. 
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BEST  COPY  AVAIWBLE 

Obnective  6  -  CAPS 


Objective  Six  -  8%c&simj  CAST  stndnta  during  tht 
1973-7'»  school  ytar  will  aco  «  Cospator  A«*i*ttd 
Ocoapatlenal  Stardi  SystMi  iMuiod  mi  Dr*»Johii  Bolland's 
^'Solf-Dlroetod  Soareh*** 

For  a  discussion  of  the  development  and  piloting  of  CAOS  see 
"Computer  Component"  under  the  PSOGRAM  DESCBIPTiON  SECTION. 

See  Appendix  D  for  sample  CAOS  student  form,  Appendix  N  for  a 
description  of  CADS  student  printout  and  Appendix  0  for  CAOS  Sjstcn 
Documentation. 
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other  Information 


Curriculum  Evaluation 

The  CAST  curriculum  is  based  on  the  Carkhuff  model  of  Exploring, 
Understandinc  and  Action.    The  curriculum  goals  and  objectives  were 
written  during  Phase  II  and  were  revised  and  formalized  during  Riase  III. 
The  curriculum  was  put  in  the  form  of  a  Phase  II  Lesson  Plan  Manual  during 
the  summer  of  1973  and  used  by  the  Phase  III  trainees.    The  data  contained 
here  refers  to  the  evaluation  of  the  Phase  II  Lesson  Plan  Manual.  (See 
Appendix  B) 
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CUSRICULIM  QOSSTIONNAISE  -  TEACHER  FOBM 
Q»n«r«l  Directtona 

Die  cttrrlculua  you  hAve  juet  tau^t  is  part  of  the  career 
education  prograa  being  deT^ioped  in  your  school  district*  A 
Mjor  goal  of  the  prograa  is  to  produce  a  curriculua  that  is 
relsTfint  and  interesting  to  students,  and  is  Tiewed  as  benefi- 
cial and  operational  by  teachers.    With  this  goal  in  mind,  it 
ifould  be  appreciated  if  you  will  spend  approxiaately  twenty- 
five  ainutes  or  so  to  coaplete  this  questiomiaire*    Tour  re- 
sponses will  be  helpllil  in  improving  both  the  content  and  use 
of  this  curriculua  unit. 

In  general,  the  questions  contained  in  this  form  require 
that  you  circle  a  letter  corresponding  to  your  response. 

The  purpose  of  this  questionnaire,  is  not  to  evaluate 
you  or  your  students;  rather,  it  is  to  evaluate  the  quality 
of  this  career  educational  curriculua  unit.    Aa  a  result,  do 
not  respond  to  any  itea  about  i^ch  you  feel  reluctant.  After 
you  have  finished  the  questionnaire,  return  the  booklet  to 
ae  at  Irving  School. 

Thank  you  for  your  cooperation* 
Alfred  L.  Pavlish 

^valuator.  Research  and  ]>evelopaent 
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CAST  JURHICULOM  QUESTIONNAIBE  -  TEACHER  FOBM  AVMUBL. 


Teacher 


School   Grade 


PAST  I    BACXOBOUMD  INFORMATION 

The  following  set  of  iteas  will  be  uaed  to  deacrlbe  the  total 
group  of  teachers  ^sbo  t«i^t  this  curriculua.    Circle  the  letter 
corresponding  to  jour  response. 

1.    What  is  jour  sex? 

a)  Feaale  b)  Male 

Z*  .  Sow  aany  years  hare  you  been  teadiiag? 

a)  Less  than  1  year  d)   6-10  years 

b)  1  -  2  years  e)  11  -  If)  years 

c)  3  -  3  years  f)  More  than  13  years 

3.  What  is  your  his^sst  level  of  education? 

a)  So«e  college  d)  Doctor's  Degree 

b)  Bachelor's  Degree  e)  Other  (Please  Specify)   

c)  Master's  Degree 

PART  II    i^SSON  PLAN  BOOK 

The  following  ittMs  relate  to  Tarious  parta  of  the  Lesson  Plan 
Book  yon  used  when  teaching  this  curriculum.  Circle  the  lett  j 
corresponding  to  your  response. 

Curriculna  Ooals  and  Perfcraance  ObjectiTOs 

4.  In  geaeial,  did  the  Curriculua  Ooals  help  you  understand  the 
intent  of  this  unit? 

s)  Tes  b)  Soaewhat  c)  No 

3.    Did  you  find  the  CurricoluB  Ooals  to  be  clearly  worded? 

a)  In  aost  cases  c)  Usually  Not 

b)  Soaetiaes  d)  Never 

6.  Did  you  feel  that  tUe  Perforaanoe  ObjectiTOS  were  clo^-^iy 
related  to  their  associated  goals? 

s)  Tes  b)  Soaewhat  c)  No 

7.  How  useful  were  the  Perfoxaaaoe  Objectives  in  obtaining  an 
overview  of  this  unit? 

a)  Very  useful       b)  Soaewhat  useful      c)  Not  useful 
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8.  Did  the  P«rfoz«ane«  Obj«etiY«t  r«pr«se&t  behaviors  that 
■ost  of  your  studtnts  would  ha?s  been  able  to  deaonetrate 
before   they  were  exposed  to  the  ettrrieulua? 

a)  ;es  b)  Soaevhat        c)  No 

9.  Did  the  Perfomaace  Objectivee  of  this  curriculiui  precisely 
indicate  the  behaTiors  your  students  ^ould  eschibit  after 
being  exposed  to  the  currioului  ? 

«)  Tes  b)  Soaeidiat         e)  Ho 

Learning  Activities  and  Associated  Materials 

10.   In  general,  the  learning  activities  specified:    (Circle  all 
that  are  appropriate) 

a)  were  satisfactoxy 

b)  provided  an  insufficient  variety  of  ways  to  learn  the  con-  . 
cepts  tao^t  in  the  unit* 

o)  req[ttired  vezy  specific  Skills  (e.g.,  susicsl  skills,  artis- 
tic skills)  not  possessed  ty  aost  teachers, 
d)  were  boring  to  aost  students* 

111   Vers  sny  unique  or  innovative  teaching  strategies  suggested 

to  you  by  the  learning  activities  contsined  in  this  eurrlculxui? 

a)  A  great  aasy  d)  A  few 

b)  Many  e)  None 

12.  Did  aay  learning  activities  in  this  curricuLui  require  sn  un- 
realistic length  of  tiae  to  cotplete  idien  tiiking  into  accoaat 
the  educational  significanes  of  these  activities? 

a)  Tes   (Please  indicate  which  objectives)  _^ 

b)  No 

13.  For  what  grade  level  would  you  judge  the  concepts  snd  Skills 
of  this  unit  to  be  aost  appropriate? 

a)  4  -  5  c)  8  -  9 

b)  6  -  7  d)  10  -  12 

14.  Do  you  feel  that  the  concepts  and  the  Skills  presented  would 
easily  fit  into  your  regular  classrooa  prograi? 

a)   Tes  b)   Scaewhat  c)  No 
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do 


15.    In  general,  t!i«  Braluation  Proc»dttr«»  »p«clfied  ia  this  curricu- 
hmt    (Circl«  all  that  ar«  appropriate) 

a)  w«r«  BOt  uaad  in  mj  cXaa^roott* 

b)  helped  to  aonitor  atttdent  progreaa. 

c)  helped  to  reinforce  a&d  atraasthen  atadent  learaiag. 
€)  None  of  the  aboTe* 


So— aiT 

16.  Are  the  leaaona  in  the  Teacher  *0  Ouide  logiealOj  aequenced? 
ft)  Tea  b)  Not  eure  e)  No 

17.  Do  you  feel  that  any  of  the  leaaona  in  thia  curriculua  contained 
&  fl^aat  biaa  (e.g.*  an  ecoaoaic,  ethnic,  racial,  atxaal,  or 
cultural  biaa)  7 

a)    Yes  (Pleaae  indicate  the  leaaoa) 


b)  No 

18.    Please  list  any  akills  which  you  feel  do  act  belong  ia  this  progra* 


19.  For  what  grade  level  would  you  judge  the  walwilary  of  this  curricu 
lua  to  be  aost  appropriate? 

a)  A  lower  grade  level  thaa  the  one  specified 

b)  The  specified  grade  level 

c)  A  higher  grade  level  than  the  one  specified 

20.  Are  there  any  groups  of  students  for  %dioai  you  would  not  recownd 
this  currlcttlu*  (e.g.,  particular  ability,  reading,  ethnic,  sexual, 
cultural,  or  socio-ecoanaic  groups)? 

a)  Tea    (Please  specify  the  group(«)  

b)  No 

21.  How  would  you  rate  the  Teacher's  Guide  ia  ccnparisoa  with  the  ia- 
stzuLtional  aaterials  traditionally  Mde  avoilabla  to  teachers? 

a)  Better 

b)  Save 

c)  Vorse 
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PART  m   5DFP0BT  SDtVIGIS  AMD  MAIBtlAIiS 

Ttf  folleviag  ittss  r«l«t*  to  tlM  MrricM  asd  uit«ri«l«  d^Yelop^d  t« 

•id  70a  in  tsw^iag  this  eurriettliia*  .Cirel*  th*  l«ttrr  corrcspoadlns 
to  jour  mapoiw*. 

Training  and  A— istmct 

22.    How  aany  bouro  of  in-Mrvico  training  rolnt«d  to  this  carricu- 
Xua  did  70U  raceiTe  b«for«  yon  actusllj  began  taaching  it? 

a)  0  d)    11  -  Ip 

b)  1  -  5  •)    16  or  Bora  hours 

c)  6-10 

23*    How  wall  did  this  spacialistd  in-atnrica  training  prapara  you  to 
daliver  the  curriculuB? 

a)  Vary  wall  d)  Poorly 

b)  Vail  a)    Vary  Poorly 

c)  Soaiawbat  f)    Mo  training  racairad 

2^.    Could  you  bava  af faotivaly  dalirarad  thia  curriculva  without  any 
specific  in-serrict  training?    (Circle  all  that  are  appropriate) 

a)  Yes  c)  Mo 

b)  Soaa  of  it  d)    No  training  received 

25.  «Vhile  teaching  thia  curriculuB,  how  aany  tiaea  did  you  raqpieat 
additional  in-sarrice  asaistanea  in  preparing  Mtorisla  for  con- 
ducting specific  learning  actiritiaa? 

s)    0  d)  3 

b)  1  •)  ^ 

c)  2  f)   More  t."an  k  (Fleaae  specif^)  


26.    How  sany  tiaes  did  your  trainer  provide  or  arrange  for  the 
specific  assistance  you  requeatad? 

a)  0  d)  3 

b)  1  9)  k 

c)  2  f)   More  than  k  (Fleaae  specify)   

27*    How  useful  was  the  cocic  book  in  delivering  the  curri cuius? 

a)  Most  use  d)    Quite  uaaaeful 

b)  Soae  use  e)   Most  uanoeful 

c)  Useful 

28.    It  you  have  your  choice  of  using  the  coaic  book  or  not,  would  you: 

a)  Uae  the  conic  book  only 

b)  Uae  the  lesson  plan  book  only 

c)  Uae  the  leason  plan  book  and  the  ccttic  book 
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BEST  COPY  AVAIWBLE 


PABI  IV     CQBBICUUDM  IMFUiaNTATIOII 

•Bi*  stt  of  itmm  that  follovs  vas  d«T«lop«<l  to  idontify  th«  rarltty  of 
mm  in  which  thi«  oarrlculna  vm  taught*    Circlo  tho  lattor  of  tht  ro* 
•poaaa  that  boat  doaeribta  what  you  did  ttaohLac  thia  eurriottljia. 

29.   Vhilo  toachiag  thia  carricalim,  aipproxlaatoly  how  aany  total  houro 
did  joa  opond  in  proparation  tiao? 

a)  0  to  1  d)   6  to  9 

b)  1  to  3  •)   9  *o  1^ 

c)  3  to  6  ^>  Mora  than  12  (Ploaao  •pacify) 


30.   Bow  did  you  ooxsally  orsanim*  year  claaa  whilo  toaehiais  thia 

carricttlua? 

a)  largo  group  (total  elaaa) 

b)  Saall  groupa 

c)  Largo  and  Mall  groupa  abcsut  oqjuOly 

d)  Othor  orginiiatioaal  prootdaroa  (FLaaao  apacify  tht  procodaro; 


31.  Whilo  toachiag  this  carricttlwa,  about  how  aaay  of  tho  loaaoaa  did 
you  hart  to  aodify  txtoaaivoayt   (Circlo  tho  aoat  appropritto) 

a)  llonoofthai?  *)   About  VJf  of  thi. 

b)  About  1/2  of  thM  •)   AlBoa*  oil  of  Htm 

c)  About  1/2  of  thM 

32.  WiMo  you  woro  toaching  thia  ourrieolua,  did  you  apond  axtra  tlao 
aftor  oach  loaaoa  roTiowiag  aith  your  elaaa  tho  baaio  coacfpta 
prtat&ttd  ia  that  loaaoat 

a)  Toa,  after  oroxy  loaaoa 

b)  Toa,  aftor  aoat  looaoaa 
e)    Toa,  aftor  a  fov  looaoaa 

d)  Ko 

33.  If  you  woro  to  toaoh  thia  earricaloa  again,  would  you  chaago  tho 
at^onciag  of  tho  loaooaoY 

a)  Toa,  I  would  mak»  gajor  ehaagoo 

b)  Toa,  I  would  aoko  aiaor  eha&goa 

o)  No 

34.  Did  ya«^  akip  aay  loaaoaa? 

a)  Mo 

b)  Toa   (Ploaao  ir^cato  tha  looaoaa) 
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35«    In  s«n*ral,  how  did  you  toach  this  curriculua? 

a)  As  an  intvrgral  part  of  an  oxlstias  aubjaet  area. 

b)  Aa  a  nvw*  atparato  topic  bocwao  tha  contont  doesn't  fit 
in  oar  usual  currieulua; 

c)  Aa  a  novt  soparato  topic  boosuao  of  the  liJid^ttd  tiao  arail- 
ablt  as  a  roault  of  fiold  tooting. 

d)  Aa  a  ntvt  soparato  topic  bocwuio  this  topic  could  not  bo  in- 
corporatod  into  tbo  ourriouliui  darias  thia  part  of  tbo  school 
yoar. 

36.    If  you  tau^t  thia  unit  tor  integrating  it  into  an  oxiatiag  subjoct 
aroat  in  %Aieh  of  tho  following  subjoct  avoaa  did  you  touch  it? 
(Circlo  Boro  than  one  area,  if  sppropriato) 

a)  I  did  not  inttgrato  this  unit  into  an  oxiating  subjoct  aroa. 

b)  Art 

c)  Businoss  snd  Office  Sdncation 

d)  Toreiga  Lsngusges 

e)  Health  Sdueation 

f )  Soae  Iconoaiea 

g)  Induatrial  Arts 

h)  language  Arta/fteadiag/!Baglish 

i)  Natheutics 
j)  Music 

k)   niysical  Sdueation 

1)  Science 

m)    Social  Science« 

n)   Special.  Sdueation 

o)    SiatritatttiTO  Sdueation 

p)    Vradea  and  Industry 

q)    Vocational  Agriculture 

r)    Other  (Pleaae  specif^)  ^ 

37»    During  how  assy  different  school  dsys  did  you  actually  teach  thia 

curriculua? 


PAST  V     CQSSlcnLiM  SIMMART 

Ih*  following  set  of  iteas  relates  to  your  s«a«r«l  iapressions  of  tais 
currieulua.    Circle  the  letter  corresponding  to  your  response. 

38.    Bow  auch  did  the  students  in  your  class  learn  about  the  career  edu- 


a)  1-5 

b)  6-10 
11-15 


d)  15-20 

e)  Over  20  (Pleaae  specify) 
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39.    In  co«pMi«on  with  traditional  iMtructioMd  Bat^riaLi,  how  wouid 
yoa  rate  thia  currioiaua  ia  iaraa  of  «tttd#Rt  laaraiag? 

a)  Kuoh  batter  d)  Woret 

b)  Battar  >for— 

c)  Saaa 

iiO.    In  oomriaoa  with  traditioaal  inatrwctioaal  «»tarl*la,  how  wotold 
TOtt  rata  thia  progra.  ia  tar«a  of  ita  abiUty  to  atijnlata  the 
lAtertata  of  r^ur  atudenta? 

a)  Httch  better  ^ot— 

b)  Better  •)  WT»9 

o) 


41.  Coapared  to  the  regular  ourriovluB,  hew  well  did  thia  curriculua 
oohaiice  lateraction  between  jou  aad  your  olaaa,  and  the  oownltj- 
at-large? 

a)  Kttch  better  *)  Worae 

b)  Better  •> 

c)  Sase 

42.  How  well  do  you  think  the  content  of  thia  cnrricttlua  would  aoraally 
integrate  into  your  regular  curriculua? 

a)  VeryweU  J****'^  , 

b)  tftii  a)   Very  poorly 

c)  Soaewhat 

43.  Overall,  how  would  jou  rate  the  qpiality  of  thia  curriculna? 

a)  fery  good  d)  Poor 

b)  Good  •)  frjvoor 

c)  ATorage 

44.  Would  yott  recoBaend  thia  eurricnlua  to  other  taaohera? 

a)  Tea 

b)  Yea«   i.th  reaenrationa 

c)  No 

45.  If  poaaiitlet  would  you  teach  thia  curriculua  to  your  atudenta 
next  year? 


a)  Yea«  with  no  aodifioationa 

b)  Tea,  with  aiaor  aodificatioxu;  Pleaae  liat 

c)  Tea,  with  aajor  iwdificationa  raeaae  liat 

d)  No 


46     Before  teaching  thia  currlculua,  how  did  you  feel  about  the 
'  WSMlity  and/or  feaalbiUty  of  iatroducing  career  education 
coacepta  to  your  atudenta? 

»)   Very  faTorable  d)  UnfaTormble 

b)   I^^rable  •)  Very  «nfaTorable 

c  )   No  opinion 
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^7. 


Haa  tMohlBg  this  eurrieulai  ehang«d  your  wLaA  about  tb%,  4t«lz«blllt j 
•114/or  fMslbillty  of  introdvoiiMs  earttr  •4uc«tlon  conoopts  to  your 
stttdtats? 


a)  Much  mv  fatorablo 

b)  More  favoxmbl* 

o)  Me  etaaaga  of  opiaiOB 


BEST  copy  mmi£ 


d)  L*8a  faTorablo 
•}  Huoh  loss  favorable 

48.    In  general,  did  teaching  thia  ourrloultn  eauae  jou  tot 
(Clrole  all  that  are  appropriate) 

«)  itork  idth  others  teachera? 

b)  beeoM  excited  about  career  edueation? 

o)  aeek  aore  iaforaatioa  about  career  eduoatloa? 

d)  iaereaae  your  knowledge  of  career  education? 
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Question  12 


TEACHER  CURRICULUM  QUESTIONNAIRE  COMMENTS 
(refer  to  questionnaire) 


Bxilky  paper^rork.    Fortas  for  Rome  objectivea  could  have  been  provided.  (Problem 
solving  pattern  forms.) 

1  -  Listing  job  titles  -  seems  it  could  be  done  m^re  efficiently. 
Question  l8 

All  skills  are  good  for  J.H.  and  High  School  students.    Skills  circled  above 

(a,  b,  c,  f)  are  good  for  elementary. 

ElerTientary  -  Job  requirements  relate  to  interests. 

At  the  7th  grade  level  -  Internship. 

At  Jr.  Hign  level  h  and  i  in  question  1?. 

Que gt ion  20 

Curriculum  can  be  adapted  to  any  group. 

Low  ability  where  it  correlates  with  poor  readers  -  unless  they  can  be 
separately  grouped  and  done  at  a  slower  pace. 
Modified  for  self-contained  special  ed.  students. 
Low  Groups 

Question  23  -  f 

From  other  teachers  involved  more  than  trainers. 
6-10  (?) 

Question  26  f 

all 

Observing  and  feedback  of  delivery,  clarification  of  terms ,  additional 
resources,  contacting  role  models  and  assisting  in  trips,  and  reviewing 
curriculiim  and  overview, 
always 

Question  30 

Pairs 

Large/small/individual 
Sorae  small  groups 

Question  3^  -  b 

Those  relating  to  interning 

I  modified  heavily.    The  basic  skille  were  reached    xcept  for  re-evaluation. 

1.  P. I.E.  job  requirements 

2.  (h)  Be-e valuation  and  i. 
All  those  in  interview  sequence. 

15,  16,  17  -  others  I  don't  remember. 
The  ones  too  difficult  for  Grade  1. 

Only  did  those  lessons  applicable  to  Ist  grade  (see  elemental y  curriculum  to 
be  completed  6/21/7^). 

I  taught  all  skills  in  5th  grade  Wisner  class.    Peggy  will  indicate  wixich  lesBona 
were  skipped  in  her  cleisB. 
Goals  13-17 
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Question       -  r 


Sepai^ate  10  -  week  course  in  language  arte. 

Question  37  -  e 

24 

150  days 
45 

Approximately  kO-k^ 

Integrated  daily.    Specially  -  k  hours  a  week 

About  30-32  (?) 

45 

At  least  ^ 

Question  ^3  -  b  &  c 

b  -  to  fit  class 
c  -  Time 

b  -  The  curriculum  changes  I  hflped  with. 

c  -  I  will  change  curriculum  for  elementary  and  give  more  integration 

to  other  content  areas, 
b  -  Wf.at  I've  discovered  this  year  -  include  this 

b  -  Concentrated  block  of  time.  w 

b  -  Simplified  format 

b  -  Expand  ideas  relating  to  1st  grade 
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Curriculum  ^uesti^ij^aire  -  Teacher  Form 

(Refer  to  questionnaire.) 
Comment SI 

a.    Responsee  tended  to  be  very  favorable  to  the  CAST  curriculum. 
Curriculum  Goals  arJ  Perfcrmance  Ob.lectives 

1.  A  majority  of  teachers  felt  -that  the  curricolum  gpale  and 
performance  objectives  were  clearly  stated  and  reflected 
behavior  that  their  students  had  not  yet  acquired. 

Learning  Activities  and  Associated  Kateriala 

2.  A  majority  of  teachers  felt  that  the  learning  activities 
included  ware  satisfactory  and  a  few  were  innovative. 

?.    Four-fifth*s  of  the  teachers  f:flt  that  the  curriculum  was 
superior  to  existing  curricu3.um. 

Training  Assessment 

h.    Seven-ninth's  of  the  teachers  felt  that  the  inservice  training 
prepared  them  well  to  deliver  the  curriculum. 

5«    All  teachers  felt  taat  the  inservice  was  necessai-y  to  deliver 
all  or  part  of  tho  CAST  curriculum. 

6.    Approximately  '.hree- fourth's  of  the  teachers  felt  that  the 
comic  book  wr.s  useful  in  delivering  the  curriculum. 

7»    Approxima*^ ely  seven-niuth*s  felt  that  the  best  way  to  deliver 
CAST  waF  using  the  curriculum  and  comic  book  together. 

Curriculyji  Implementation 

8.  A  ajajority  of  teachers  felt  they  would  make  eosae  modification 
in  the  sequencing  and  content  of  the  i«SBono. 

Curriculum  Summary 

9.  Over  three-fourths 's  of  the  teachers  felt  that  the  curriculum 

w£3  better  than  traditional  materials  in  terms  of  student  learning. 

10.  All  but  one  of  the  teachers  felt  that  the  CAST  curriculum  could 
be  integrated  into  the  regiaar  curriculuiD. 

11,  All  teachers  felt  that  their  students  learned  an  average  amount 
or  more  about  career  education  and  csureei"  skills. 

b.    Possible  areas  to  improve  CAST  program: 

Item  #10    "More  vsuriety  of  ways  to  learn  concept" 
requested  by  7  out  of  l8  teachers. 
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Item  #15.    Evaluation  procedure  responses  indicated  that  three- 
fifth's  of  the  teachers  felt  that  the  evaluation 
procedures  could  be  improved. 

Item  #16.    The  sequencing  of  objectives  is  an  area  to  be  reviewed. 

Item  #31.    Teachers  indicated  they  had  to  extensively  modify 

»'about  1/2"  of  the  lessons.  This  was  primarily  because 
of  time. 


Conclusion  - 


The  teacher  and  counselor  comments  in  the  areas  of  learning  activities, 
curriculum  implementation  and  curriculum  summary  support  the  fact  that  the 
Phase  II  Lesson  Plan  Manual  was  best  used  as  a  teacher-counselor  training 
tool  not  a  delivery  tool.    Effectx/e  teachers-counselors,  once  having  learned 
the  skills, are  more  comfortable  developing  their  own  way  of  teaching  the 
lesson  than  following  son..-ne  els^s  lesson  plan.    Also,  if  teachers- counselors 
develop  their  cwn  lessons  it  helps  them  to  understand  the  skills  better  and 
fosters  the  investment  of  themselves  to  the  successful  delivery  of  the  program. 
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Att.  tudeData 


Student  Reactions 

A  questionnaire,  designed  by  the  project  director,  was  given  to  the 
students  in  an  effort  to  determine  the  attitudes  and  perceptions 
regarding  the  CAST  cxirricvaum  and  program. 

The  selection  of  students  was  not  systematic  in  that  all  the  students 
at  a  grade  lavel  were  from  a  single  class.    There fore «  the  attitudes  and 
perceptions  of  thc-se  ftudents  may  be  as  much  a  function  or  determined  by 
the  teacher  as  by  the  curriculum.    However,  since  the  purpose  of  gathering 
this  data  was  more  for  formative  than  product  summative  evaluation  the 
information  received  is  of  significant  value  to  the  curriculuir  writers. 

The  following  is  a  con'-pilation  of  the  two  grade  levels  surveyed.  Where 
possible,  the  two  grades  are  presented  with  the  item  7th,  and  8th  respectively. 
Where  the  items  require  lengthj.y  analysis  snd  responses,  the  grade  levels 
are  reported  individually. 
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student  Nas* 
School 

T#«ch«r   

Dfttf  


Airera^e  Response 


7th 

8th 

5.0 

3.1 

2.7 

2A 

3.2 

3.^ 

5.5 

5.1 

2.9 

2.5 

5.2 

2.2 

5.2 

5.1 

5.1 

2.5 

'  5.1 

2.8 

4.0 

2.7 

2.6 

;  2.9 

2.8 

CAST  STUDENT  SUBVinT 

1.    tTse  the  following  acftlt  to  show  how  wjck  you  liked  ••ch  of  the 
CAST  activitiea  listed  below.    (Put  the  Bu»b«r  xa  the  blank  be- 
fore each  letter. )    Add  any  actiTitie*  you  feal  were  left  out. 

5  -  liked  the  aost 
k  "  liked  •  lot 

5  -  Uked  OK 

2  -  Uked  ft  little 

1—  liked  least 


A 

B 
C 

"d 

E 
t- 

G 
'K 
I 
J 
K 
L 


Exploring  pauy  different  joba 

Exploring  «aay  dif f er*ttt  job  inforaatiott  eeurcea 

Sjcplorittg  .uy  intereata 

Exploring  «y  T-luea  (thoae  things  that  are  i»portant  to  «e; 
Learning  how  to  ack  qaeaticma 
Learaing  how  to  »ake  a  carear  deciaion 
Learning  about  ay  ideal  Job 

Learning  to  attend  t  obcerre,  listen  and  Ksasarise 

Learning  about  others'  values  and  interests 

Gk>ing  on  internship 

Be-evalu&ting  sty  decision 

Setting  a  goal  and  ieveloping  a  program 


AvsreaKe 

He'spons© 

7th 

5th 

5.^f 

5.5 

5.0 

5.9 

%h 

5.5 

5.1 

5.^ 

5.0 

5.1 

5.1 

2.6 

3.^ 

5.1 

5.0 

2.8 

5.1 

2.9 

KIse  the  following  scale  to  show  how  helpful  each  of  these  skills 
is  to  yn?  in  planning  your  career,  ihit  tha  nuabar  in  the  black 
bafora  each  letter. )    Add  any  skill*  you  faal  ware  left  out. 

^  -  Most  helpful 

k  "  Soaewhat  helpful 

3  -  OK 

2  -  A  little  helpfttl 
1  »  Least  helpful 

A.  Skills  learned  to  explore  joba 

B.  Skills  learned  to  es^plore  Job  aouroaa 
"c.  Skills  learned  to  escplore  wyaelf 

~D.  Skills  learned  to  relate  ay  iiiteraste  to  the  job  requirtsa&ts 
"S.  Skills  leained  to  sake  a  decision 
"r.  sacillis  iearr»ed  to  aak  cjaestions 
"g.  Skills  learned  to  conduct  By  interriew 
E.  Skillo  learned  to  re-evaluate  ay  decision 

Skills  learned  to  set  a  goal  and  develop  a  program 
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Wl-ich  of  the  aboTO  okilla  (in  #2)  hav.  jo«  uaed  In  an  area  other 
ttaa  career?    Uat  the  letter  (or  l*ttera)  here: 


Think  back  to  where  you  were  in  rtlationahip  to  •       ^^•f  J^^^* 
bef^e  you  started  CAST.    Circle  the  atateiaent  vhich  beat  dea- 
cribea  yoU  at  that  tiae. 


Before 
CAST 


Had  definitely  decided  what  j-^b  I  wanted 
Had  alK»«t  decided  about  the  job  I  wanted 
Ead  decided  what  intereat  area  I  wanted 
Sad  a  general  idea  of  the  job  I  wanted 

Bad  no  idea  vhat  kind  of  job  I  wanted 


^5  -  Hare  definitely  decided  what  job  I  want 
k  -  Have  alaodt  decided  wh*^  ^ 
After       ^  5  -  Have  decided  what  job  I  want 

2  -  Have  a  general  idea  what  job  I  want 
1  -  Bare  no  id««  of  what  job  I  want 


CAST 


U    Circle  the  >oat  important  thing  you  learned  fro«  your  internship. 

A.  Vhat  the  worker  has  to  do_on  hia  job 

B»  Finding  out  what  the  worker  haa  to  toow  about  hla  job 

C.  Learning  how  the  worker  feele  about  hia  job 

j5.  Seeing  the  working  conditions 

E.  Perfortting  a  job  activity 

6.  Circle  til  the  thinga  you  learned  about  your  values  or  interests 
that  you  did  not  know  beforethe  CAST  prograa. 

A     i^mmetA  I  had  aore  values  than  I  had  thought  .  ^ 

i:    t^fi  iyval^a  change  with  new  infection  and  with  experience 
C     L^lScd  Z  value,  are  different  that  other  P»<^Pi«»' J'i^** 
I:    ll^ld  Sat  aoae  jobs  «eet  more  of  «y  valuea  than  other  joba 
E.    Learned  nothing  new  about  oy  values. 

7.  At  your  age,  do  you  feel  that  it  is  i«portant  to  ba  exploring  your 
intereats  in  relation  to  jobs?    Why  or  why  not? 


8.    Circle  how  »any  ti«es  you  talked  to  your  parenta  about  career  before 
you  were  in  the  CAST  prograa. 

5  -  more  than  5  times  per  week 

i  -  5  times  per  week 

3-2  times  per  week 
10*^'^  tiaeper  week 
■*■    ^1  -  none 
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BKT  copy  mmii 


iveraf-:e  Response 
Sth 


r 


-Now  circle  how  oany  tines  you  ha^  t»lk«d  to  your  paroata  about 
car«»rs  aince   you  have  been  in  the  CAST  program. 

2   

3  3  -  aore  than  3  tiaea 
10  if  -  5  ti«e» 

^  5-2  timeo 

a  -  1  tiae 
X  -  none 

9.    Circle  the  au"     '  indicating  how  you  would  like  CAST  to  be  twight. 

1  '  as  a  separate  courae 

2  -  aa  part  of  one  of  ay  other  coursea 

10.  ks  a  separate  couree,  circle  how  long  yott  tli'ak  CAST  abould  be  taught 
^  at  your  grade  level? 

7  5-1  year  couree 

7  k  '  1  aeffleater  courae. 

5  5-10  week  courae 

5  2-5  weak  couree 

1-3  week  courae 

11,  Do  you  feel  that  taking  this  course  again  %rould  help  you  learn  the 
akille  better? 
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CAST  Student  Survey  Comnjents 

Question  7  -  7th  grade 

Yes,  because  you  therefore  would  know  what  it  is  about. 
Money  and  helping  people. 

Yes  I  because  if  you  like  it  &  lot  you  should  be  able  to  find  out  as  much  as 

you  can  about  that  job. 
Yes  I  it  will  help. 

YeS|  because  I  want  to  know  what  I*m  supposed  to  do. 

Good  education,  you  can  get  gjood  pay. 

To  have  some  experience  about  the  job. 

YeSf  it  will  help  me  when  I  get  older. 

Yest  because  at  a  later  age  it  could  be  too  late. 

YeSf  so  you  have  an  idea  what  job  you  like. 

YeSf  so  you  can  know  if  you  would  want  it  when  you  grew  up. 

You  can  get  a  better  general  idea  of  your  job. 

Yea I  so  you  will  know  what  you  want  to  do. 

It  is  important  to  know  what  job  and  about  it. 

Yes,  because  if  you  start  leai'ning  yotmg  you  will  know  more  when  you  get  older. 

Yes,  so  you  can  have  time  to  change  your  mind  about  the  job. 

Yes,  60  when  you  graduate  most  likely  you  will  know  whether  or  not  you  want 

the  job. 
To  make  money  for  a  living. 

Yes,  because  when  we  get  older  we  may  get  a  job,  which  doesn^t  suit  us.  But 

this  way  we  are  siu^e  to  get  a  Rood  nob. 
Yes,  because  they  should  let  us  know  how  they  work  on  their  job. 
Yes,  because  we^re  half  way  through  school  and  should  start  thinking  of  a  job. 
Yes,  because  when  I  get  older  1*11  know  what  kind  of  job  I  want. 
Yes,  because  you  have  to  know  to  get  what  you  want. 

Yes,  because  when  it»s  time  for  your  job  you  would  know  more  about  this  job. 
No,  I  don't  like  it. 

Yes,  because  you  can  build  up  your  interest  in  a  job  career  and  really  put 

your  mind  to  work  in  thinking  about  a  job. 
Yes,  so  you  know  what  it^s  like- 

No,  because  you  might  get  another  idea  of  a  job  but  not  another  chance  to 
explore  it. 

Yes,  because  you  need  to  get  ahead  start  to  get  a  job  and  know  how  to  interview. 

Yes,  because  people  learn  about  jobs. 

Yes,  because  it  will  help  us  in  the  future. 

Yes,  it's  OK  but  it's  boring. 

Yes,  because  you  set  your  own  goal,  and  you  would  be  looking  forward  to  that  in 
the  future.    A  job  that  you'd  be  learning  at  my  ag^,  and  would  know  what  job 
you  wanted. 

Yes,  because  it  may  make  you  change  your  mind  about  your  job. 
Question  11  -  7th  grade 

Yes,  because  I  know  what  they're  about  and  I  could  understand  them  better. 
Yes,  and  I  hope  they  do  what  I  want  them  to  teach  a  whole  semester  course. 
No,  I  DON'T  LIKE  IT. 

Maybe,  if  you  did  some  of  it  with  out  a  lot  of  second  chances. 
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CAST  Student  Survey  Comments 


Question  7  -  8th  grade 

Yes,  you  have  to  start  exploring  sonsetime. 
Yes,  because  you  will  have  to  have  a  lob. 

Yes,  if  you  know  now  what  you  want  to"do,  or  have  on  idea,  then  you  can  gather 

information  and  prepare* 
Yes,  students  are  always  saying  why  do  we  have  to  learn  this?    Well,  they  are 

finding  out  that  they  might  be  able  to  use  this    in  their  future  job.  (This 

pertains  to  school  work.) 
Yes,  so  you  can  get  the  education  you  need. 

Yes,  so  when    you  get  a  job  you  know  partly  what  you  want  to  be. 

Yes,  because  you  can  learn  your  values  long  before  ycu  ptart  your  job. 

Yes,  because  I  can  start  working  at  any  time. 

No,  because  the  kids  feel  like  it»B  just  another  class  and  they  try  to  find 
shortcuts. 

Yes,  it's  not  too  long  till  I'll  be  looking  for  a  job. 
Yes,  you  should  plan  ahead  and  know  what's  gt Ing  on. 
Yes,  so  I  can  get  a  good  job. 

No,  because  you  can  still  figure  out  a  job  when  you  get  older. 
Yes,  very  soon  I'm  going  to  need  a  ;}ob. 

Yes,  in  a  way  because  you  at  least  find  out  what  the  job  does,  and  if  it  suits 

your  values. 
No,  because  it  is  not  necessary  yet. 

Yes,  so  that  you  can  ask  questions  and  get  a  better  understanding. 
Yes,  to  know  what  to  expect. 

Yes,  so  you  know  whether  or  not  you  really  want  tha  job. 

Yes,  that  way  you  will  be  able  to  find  out  more  about  your  job. 

Yes,  because  then  when  you  get  older  you  will  know  what  your  job  is  and  so 

you  can  prepare  for  it. 
Yes,  to  get  me  prepared  for  college. 
Yes,  it*s  only  a  few  more  years  till  I  gradxiate. 

Yes»  because  when  you  get  older  you  won't  know  what  you  ar^»  r«&lly  interested 
in,  now  you  have  a  chance  to  find  out  what  it  is» 

Question  11  -  8th  grade 

No,  because  we  have  already  been  taiight  the  skills. 

I  don't  think  so.    I  will  just  be  learning  them  over  again,    I  won't  learn 
anything  new. 

Yes,  I  got  to  be  in  the  CAST  Program  in  the  seventh  and  eighth.    I  used  the 

same  job  in  both.    I  would  now  like  to  do  another  job. 
Yes,  because  you  would  probably  learn  more  the  second  time. 
No,  considering  that  I  didn't  learn  anything  the  first  time.    The  only  new 

things  more  to  dumb  to  really  use. 
Yes,  to  help  me  get  prepared  for  the  right  job. 

Yes,  because  you  know  what  most  of  it  now  is  you  take  it  again  you  will  know 
it  better. 
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CAST  Student  Questionnaire 


• 


Question  1.     Like  to  Exploring,  learning  doin^ 


Item 

A 

B 

C 

D 

£ 

F  ' 

C 

H 

I 

J 

K 

L 


Average  Response 
7th  M 

3.0 
2.7 
3.2 
5.5 
2.9 
5.2 
5.2 
3.1 

5.1 
h.l 

2.7 
2.9 


th 
5.1 

3.^ 
3.2 
2.5 
3.2 

3.1 

2.6 
2.8 

^*.o 

2.6 

2.8 


^fsr  COPY 


Rank  order  of  Items  -  Average  Response 


Seventh  Krade 

Ki^hth  pcra'ie 

Item 

Averays^e 

Description 

Item 

Average 

Description 

J 

^.12 

Internship 

J 

^.00 

Internship 

D 

3.30 

My  Values 

C 

3-^ 

My  interest© 

Q 

3.2^ 

Ideal  Job 

D-F 

3.2 

values, 

F 

3.20 

Career  Decision 

C«reer  Decision 

C 

3.16 

}fy  interests 

A 

3.12 

Different  Jobs 

H 

5.12 

Attend,  observe 

G. 

3.11 

Ideal  Job 

listen,  summarize 

I-L 

2.8 

Other's  Values, 

I 

3.10 

Other's  values « 

Interests;  Goftls 

Interests 

and  Programa 

A 

3.00 

Different  Jobs 

K 

2.6 

Re-evaluate 

L 

3.9^ 

Goals,  Programs 

H 

2.53 

Attend,  Observe 

E 

2.90 

Questions 

Listen,  Summ- 

arize 

K 

2.7^ 

He-evaluate 

B 

Information 

Decision 

Sources 

B 

2.73 

Inf orroat  ion 

2.35 

Questions 

Sources 
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Question  2.    Helpful  Skills 

a.      Item  Average  Responge 


7th 

8th 

3-3 

B 

2.9 

c 

5.3 

D 

3.1 

3.^ 

B 

3.0 

3.1 

F 

3.1 

2.6 

G 

3.1 

H 

3.0 

2.9 

I 

3.1 

2.9 

b.    Rank  Order  of  Items  -  Average  Response 


Seventh  graae 

tem 

Average 

Description  -  Item 

Dsscrintion 

Q 

Conduct  Inverview 

D 

to  Jobs 

A 

Explore  Jobs 

A 

3.31 

Exploi*e  Jobs 

C 

3-38 

Explore  Self 

C 

3.30 

Explore  self 

F 

3-13 

Ask  Questions 

3.12 

Make  a  Decision 

D-I 

3-13 

Relate  Interests 

to  JobSf  set  Goal 

G 

5.11 

Conduct  Intel*- 

and  Develop  Program 

viev 

3 

2.92 

Sjqilore  Jcb 

Sources 

B 

3*04 

Explore  Job  Sources 

I 

2.93 

Set  Go<a  Develop 

Program 

H 

3.02 

Se-evaluate 

Decision 

F 

2.63 

Ask  Questions 

ERIC 
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Seventh  Grade 
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Comparing  Quest ions  1  and  2 

(1)  The  response  range  2.5  to  5«5  representing  OK  contained  all  Item 
averages  except  1  (Question  1,  Item  J  -  Internship) 

The  Interniship  was  "Liked  a  lot" 

(2)  Recognizing  vHat  response  averages  were  *K)K" 

a.  'Tle-evaluatiusj  a  Decision"  tended  to  be  Least  Liked  and 
corisidered  Least  Helpf'^  of  skills  learned.  • 

b.  Similarly,  "Information  or  Job  Sources"  efforts  were  also 
Least  Liked  and  considered  Least  Helpful.** 
"Exploring  Jobs"  was  ranked  below  average  under  Lik^d  and 
very  high  under  Helpful  Skills  learned.*** 

d.  "My  Values  or  Exploring  Self"  average  respo.nses  ranked  high 
for  both  Liked  and  Helpful  quest iona. 

e.  Rankings  of  Items  Common  to  Questiorjs  1  and  2. 

Rank  Order  of  - 

Liked  Areas:  Helpful  Skillst 

My  Values  Explore  Jobs 

Career  Decision  Explore  Self  (Values) 

Different  Jobs  Questions 

Goals  -  Programs  Qoals  -  Programs 

Questions  Sources  (information) 

Re-evaluate  Decisiorjs  Re-evaluate  Decisions 

Information  Sources  Career  Incision 

Comments 

Although  these  students  "Liked"  tne  CAST  activity  "Learning  how  to  make 
a  Career  Decision",  they  apparently  did  not  see  the  "Skills  learned  to  make 
a  decision"  were  helpful  in  planning  their  career, 

Tliis  suggests  that  more  time  needs  to  be  spent  in  relating  to  career 
planning.    Because  communicating  is  &  new  skill  for  7th  graders  it  will  take 
more  time  for  them  to  see  the  value  of  decision  making  as  it  relates  to 
career  planning. 

*  A  possible  explanation  for  2a  is  that  most  teachers  did  not  have  time  to 
teach  this  skill. 

Only  one  hour  was  spent  on  information  sources.    Because  of  time  the 
internship  was  the  main  information  source  used. 

Due  to  time  again,  exploring  jobs  was  done  through  limited  strategies 
and  therf»forc,  even  though  the  students  found  it  helpful,  they  are  sayinp: 
i*  ~ould  have  bc-en  more  interesting. 
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8th 


Eighth  Grade 

CompaLrin|3:  Questions  1  and  2i 

(1)  The  response  range  2.5  to  3.5  r^preMn.ing  ^  contained  all  Item  Averages 
except  5  (Question  1,  Item  J,  B,  E) 

The  Internship  was  "Liked  a  Lot*' 

Information  Sources  and  Asking  Questions  were  "Liked  a  Little". 

(2)  The  reink  ordering  of  response  averages  indicates: 

a.  Learning  how  to  "Ask  Questions"  was  Least  Liked  and  considered  Least_ 
Helpful  in  planning  their  career. 

b.  '"Exploring  My  Interests"  and  '^Relate  My  Intereste"  were  Liked  much 
and  considered  very  Helpful. 

c.  "Exploring  My  Values"  and  Exploring  Hyself"  ranked  high  among 
common  items  under  Liked  and  Helpful. 

d.  Bankings  of  Items  Common  to  Question  1  and  2; 

Sank  Order  of  - 

Liked  Areas  Helpful  Areas 

My  Values  Explore  Jobs 

Career  Decision  ^^orc  Self  (Values) 

Different  Jobs  Career  Decision 

Cloals  and  Programs  Job  Sources  (Explore  Infor- 

mation} 

Re- evaluate  Decision  Goals  and  Prograas 

Information  Sources  He-evaluate  Decisions 

Ask  Questions  Ask  Questions 

Comments: 

The  CAST  program  directed  towards  the  skill  area  "Asking  Questions"  was  both 
least  liked  and  coneidered  least  helpful.    The  importance  of  this  skill  to 
decision-making  is  apparent  from  the  attention  the  CAST  progi-am  places  upon 
.  asking  questions.    ThiB  skill  represents  a  highly  active  intellectual  involve- 
ment with  a  task.    Perhaps  the  area's  relatively  low  ranking  represents  the 
difficulty  of  teachers  in  co-.imunicating  to  students  how  this  skill  is  the 
basis  for  all  exploration  for  or  '  expansion  of  information. 
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Question  3    Skills  used  in  another  area 


Item 

Skill 

Fr( 

jc^uency 

otn 

A 

Sxplore  Job 

9 

B 

Job  Sources 

7 

5 

C 

Explore  Self 

9 

10 

D 

Interests 

6 

k 

£ 

Decisions 

16 

13 

F 

Questions 

13 

7 

G 

Interview 

7 

5 

K 

Re-evaluate 

8 

5 

I 

GJoal  —  Prograin 

6 

5 

Rank  Order  of  Skills  for  Questions  2  and  3  Seventh  Grade 

■  ■■  ^1  ■  I  II II  .■■ 

Helpful  in  Planning  Career  Skills  used  in  Another  Area 


Conduct  Interview 
Explore  Jobs 
Explore  Self 
Interests 
Goal  -  Program 
Ask  Questions 
Explore  Sources 
Re-evaluate  Decision 
Make  a  Decision 


Make  a  Decision 
Ask  Questions 
Explore  Job 
Explore  Self 
Re-«evaluate  Decision 
Explore  Sotirces 
Conduct  Interview 
Interests 
Goal  -  Programs 


Rank  Order  of  Skills  for  Questions  1  and  2  Eighth  Grade 
Helpful  in  Plarjiing  Career 


Relate  Interests 

Explore  Jobs 

Explore  Self 

Make  a  Decision 

Conduct  Interviews 

Explore  Job  Sources 

Set  GoelI  -  Develop  Program 

Re-evaluate  Decision 

Ask  Questions 


Skills  Used  in  Another  Area 

Make  a  Decision 
Explore  Self 
Ask  Questions 
Explore  Jobs 
Job  Sources 
Re-evaO-uate 
Goal  -  Program 
interests 
Interview 
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Comments?    Seventh  Grade 


"Skills  learned  to  make  a  decision"  were  noted  most  often  as  used  in  an  ar^a 
otner  than  career  planning;*    Surprisingly  this  item  was  considered  least 
helpful  in  planning  a  career*    Decision-making   was  liked  OKf  considered 
least  Helpful  of  all  skills  in  planning  a  career »  but  most  often  noted  as 
Helpful  in  other  areas*    Clearly,  the  CAST  Decision-Making  process  is  not 
as  well  rated  by  the  students  as  other  skills  when  planning  a  career  even 
though  the  students  like  the  CAST  approach  and  consider  it  helpful  in  other 
areas.    This  suggests  that  more  time  needs  to  be  spent  in  showing  students 
the  relationship  between  decision  malong  and  cetreer  planning. 

Comments:    Sif^hth  Grade 

Skills  learned  to  "Mal<:e  a  Decision"  were  used  most  often  of  areas  other 
thsci  career  planning*    A  wide  variation  in  rank  order  is  present  for  the 
skill  "Relate  Interests"  which  is  most  Helpful  in  planning  a  career  but 
nearly  Least  used  in  other  areas^    The  skill  "Asking  Questions",  although 
considered  least  Helpful  in  planning  a  career  was  used  frequently  in  other 
areas.    Af^ain  this  pattern  of  having  a  skill  rated  high  in  the  "helpful  in 
planning  a  career"  category  and  low  in  "helpful  in  other  areas"  category  or 
vice-versa  indicates  that  more  emphasis  needs  to  be  placed  on  the  relation- 
ship and  value  of  these  skills  in  career  planning  as  well  as  the  generalized 
usefulness  in  other  areas.    The  use  of  the  skills  in  areas  other  than  career 
was  not  specifically  addressed  in  the  CAST  delivery. 
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Question        Job  Decision,  Before-After  CAST     Seventh  Grade 


a.  Response  Data 

Before  avg.  =5.30  After  CAST  Avg.  s  3,5^ 

b.  Impact  of  OSI 

A  ripple  effect  is  present  in  the  response  data.    The  niimbers 
indicate  an  upward  shift  of  one  level  by  three  students  at  each 
before  CAST  level  (e.g.  three  students  with  a  before  CAST  response 
of  k  moved  to  5  after  CAST),    Similar  movement  occurred  for  students 
at  levels  1,  2,  and  3  on  the  before  CAST  distribution. 

Question  $.    Learned  from  Internship 
a.    Response  Data  -  Rank  Order 

-  What  worker  has  to  know  about  job  -  10 

-  How  worker  feels  about  job  -  9 

-  Seeing  working  conditions  -  7 

-  Performing  job  -  2 

Comments? 

Knowledge  required  and  worker  feelinge  dominate  learnings  about  job 
activities.    The  response  data  seemed  far  short  of  the  fifty-one  students 
responding  to  the  questionnaire. 

Question  6.    Learnings  About  Values  or  Interests 

a.  Response  Data  -  Hank  Order 

Approximately  30  to  40  percent  of  the  students  were  responsive  to  the 

learnings! 

-  More  values  than  they  thought  -  15 

-  Values  change  with  information  and  experience  -  1^ 

-  Values  are  different  than  other  peoples*  values  -  12 

-  Some  jobs  meet  more  values  -  19 

Question  7.    Importance  of  Exploring  Interests 
a*      Response  Data 

Yes  -  36  92.3% 
No  -      3  7.7^ 

b.  Student  Comments 

(refer  to  attached  sheet  with  questionnaire.) 
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Question         Talking  with  parents  about  career 


Seventh  Grade 


a.    Response  Data 


Rate  Before  CAST  During  CA^T 

5  ^  More  than  3  times/week  6  8 

^  -  3  tines  per  week  5  5 

3      2  tines  per  woek  6  11 

?  -  1  tirr.e  per  week  15  11 

1  -  None  15  8 

Average  m  2c^2  Average  =  2.86 


b.    The  rnajor  shift  was  out  from  the  '^NONE*'  level  Before  CAST    and  an 
incren.se  at  the  *^?  tines  per  week*^  level*    The  average  increase  was 
equivalent  to  an  average  of  1  more  tine  every  two  weeks. 

Question         Ho\-;  to  teach  CAST 

As  a  separate  course  -  26 

As  part  of  one  of  other  courses  -  1? 
Quertion  10^     As  a  separate  course  how  long  should  CAST  be  taught 

1  year  course  -  7 

1  senester  course  -  l8 

10  week  course  11 
5  week  course  -  h 
3  week  course  -  2 
Question  11 >    Would  taking  course  again  help  learn  skills  better 

Yes  -  P7  %  =  77.1^ 

No  -  5 
Maybe  -  3 
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Question         Job  Decision  -  Before »  After  CAST  Eighth  Gr&de 

a*    Response  Data 

Before  CAST  Average  -  2.6k  After  CAST  average  ^  3*58 

h.     Impact  of  CAST 

The  response  average  moved  from  midway  between  *^ad  a  general  idea** 

and  **Had  decided  what  interest  area**  before  CAST  to  midway  between 

*M{ad  decided  what  int^jrest  area"  a  id  •'Have  almost  decided  what  job 

I  want.'*    An  obvious  movement  appears  towards  a  career  decision 

response 


Question  3>    Learned  from  Internship 
a.    Response  Data  -  Rank  Order 

-  What  worker  has  to  do  on  his  job  -  9 

-  Soeinc  workinf;;  conditions  -  8 

-  Finding  out  what  the  worker  has  to  know  ^ 

-  Learning  r.ow  worker  feels  about  his  job  -  5 

-  PerforrTiinR  a  job  activity  -  J> 


yaestior.  6>    Learninc  about  Values  or  Interests 

a.  response  Data  -  Rank  Order 

-  1  ^-^d  more  Values  than  thought  -  1^ 

•   Some  jobs  meet  more  of  my  values  -  1^ 

-  My  values  change  with  nev;  information  -  11 

-  My  values  are  different  from  other  peoples  values  -  11 

Question  7*     Importance  of  Exploring  Interests 
a»     Response  Data 

Yes  -  21    87*5/^  No  -  3  12.59^ 

b.  Student  Comments 

(Refer  to  coinments  attached  to  questionnaire.) 
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Question  8>    Talking  with  parents  about  career 
a»    Response  Data 


Eighth  Grade 


Rate  Before  CAST  During  CAST 

5  -  More  than  5  times/week  1  5 

4-3  times  per  week  2  2 

3-2  times  per  week  2  ? 

2-1  time  per  week  7 

1  ^  NONE  12  ^ 

Average  =  1*88  Average  =  2.77 


b.    The  average  number  of  talks  with  parents  increased  approximately 
1  time  per  we ok  during  CAST.    Several  students  began  to  talk 
with  parents  who  had  not  prior  tc  CAST. 
(Question  9*    How  should  CAST  be  taught 
As  a  separate  course  -  1^ 
As  part  of  one  of  other  courses  -  11 

Question  10.     As  a  separate  course  how  long  should  CAST  be  taught 
1  year  course  2 
1  semester  course  -  7 
10  week  course  -  7 
5  week  course  -  3 
3  week  course  -  ^ 

Question  11.    Would  taking  course  again  help  learn  skills  better 
Yes  -  11 
No  -  11 
Maybe  -  ^ 
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ComparinK  seventh  und  eighth  Rrades 
Response  Data  -  CAST  Student  ftuestionnaires 

Question  1.    Rank  order  listings  of  response  averages  were  similar, 
<iuestion  ?.    The  rank  order  listings  differed  -.nost  for: 

Item  Grada  7  Qr&de  8 

Conduct  Interview  1  5 

Relate  Interests  to  Job  5-6  1 

Make  a  Decision  9  ^ 

Ask  Questions  ^  9 

The  area  '^Ask  Questions^*  ranked  last  for  eighth  graders  under  Liked  Areas 
and  Helpful  Skills^  This  area  was  not  ranked  so  low  by  the  seventh  graders* 
Question  5.     Rank  orders  of  response  averages  for  seventh  and  eighth 

nrade  data  were  similar. 
Question  ^.    The  before  CAST  average  for  seventh  graders  was  higher  than  for 

eighth  praders.     However »  after  CAST  averages  were  essentially 

the  sajne  -  approaching  '^Have  almost  decided  what  job  I  want." 
Question  5.    The  seventh  ^i^aders  were  not  as  interested  in  what  a  worker 

does  on  job  as  were  the  eighth  graders.    The  number  of 

re;.i.ondents  for  this  question  was  small. 
Question  6,    Responses  were  similar.    However,  the  items  to  this  question 

received  responses  from  only  a  small  percentage  of  the  students. 
Question  7.     "Yes"  response  percentages  were  near  90%  for  both  seventh  and 

eighth  graders. 

Question  8*     The  eighth  graders  increased  their  talks  wixh  parents  more 

than  the  increase  percent  in  seventh  grade  responses.  Both  grades 
approached  an  average  of  "?  times  per  week"  during  CAST. 

Question  9*  The  majority  of  both  seventh  and  eight  graders  prefer  CAST  be 
taught  as  a  "separate  course".  However »  approximately  of 
the  respondents  indicated  their  preference  was  for  CAST  to  be 
^'pr^rt  of  one  of  my  other  courses." 

Question  10.  Most  students  preferred  CAST  to  be  taught  either  in  a  "10  week 
course"  or  in  a  "  1  semester  coursv.." 

Question  11.  Approximately  80%  of  the  seventh  graders  felt  taking  CAST  again 
would  help  to  learn  skills  better.  Approximately  hCf^  of  eighth 
graders  felt  that  way. 

Conclusions 

Seventh  and  eighth  graders  differed  in  their  perception  of  what  was  most 
valuable  to  them  in  the  CAST  program.  For  the  most  part,  it  can  be  concluded 
that  the  major  reason  the  students  differ  in  their  responses  to  the  various 
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components  of  the  program  is  due  to  the  differences  in  -eacher  emphaais 
and  understanding  of  the  various  skille  be^.ng  taught  and  the  teacher  ability 
to  help  the  otudents  ;..ee  how  these  skills  are  useful  in  their  day  to  day 
living. 

Students  talked  with  their  parents  more  about  their  career  because  of 
their  involvement  in  the  CAST  program. 

Students  felt  that  CAST  should  be  taught  either  as  a  10  week  or  semester 
course  so  they  could  have  more  time  to  learn  aiid  practice  the  skills. 

Students  were  generally  very  favorable  to  the  CAST  program.  However, 
teaching  the  class  ob  ve  did,  one  day  a  week  for  the  entire  year  was 
determental  in  holding  str.dent  interest.    In  spite  of  the  way  it  had  to  be 
taught,  it  can  be  concluded  that  students  did  learn  many  new  skills  that 
were  helpful  to  them. 
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Parent  Survey 


Three  Junior  High  teachers »  one  from  each  grade  level i  surveyed  selected 
parents  of  their  students  in  ar  effort  to  assess  their  attitudes  and  percep- 
tions regarding  the  CAST  program. 

As  with  the  student  surveys,  the  selection  of  teachers  and  their  subsequent 
selection  of  parents  does  not  allow  one  to  make  generalizations  regarding 
the  curriculum  ner  se.    The  reaction  of  these  parents  are  likely  to  be  deter 
:.iined  by  teacher  quality  as  well  as  or  more  than  curriculum  characteristics* 

Two  different  forms  of  the  questionnaire  were  used*  The  7th  and  8th  grades 
used  similar  forms  while  the  9th  grade  used  a  form  designed  a  year  earlier* 

The  following  is  a  copy  of  the  questionnaire  and  the  frequency  of  responses 
to  the  items.    A  total  of  59  parents  returned  the  questionnaire* 
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0«ar  Parents t 

Can  you  help  ae  evaluate  our  career  program?  FLeaoe 
check  questions  below. 


Queationnaire  for  Parents 

1*    Did  you  know  that  your  child  was  learning  about  jobs?  Yes 

2.    Do  you  feel  that  It  is  helpful  for  young  children  to 
learn  about  many  careers? 


5.    Has  yoiir  child  spoken  about  the  workers  who  have 
visited  the  class? 


4, 


Group  I 

Group  2 

Yes  [ No 

Yes 

No 

11  ^  1 

6 

0 

Librarian 
Nurse 


Mailman 


Policeman  -9 


Ambulance 
Driver 


Policeman 
and  Dog 


Principal 


-about  the  places  we  have  visited? 


Post  Office 


11 


McDonald *e 


2 


Police  Station 
Dairy  Farm  1 


o 


Da%m  Donuts 


2 


Are  you  fajailiar  with  our  class  rating  scale: 

P  -  participant  -  student  does  just  what 

the  teacher  asks 
C  *  contributor     student  does  what  is 

asked  plus  something  extra 
L  -  Leader  -  student  does  what  is  asked  - 

plus  extra  -  plus  helps 

other  student  to  be  a 

participant 

5.    Does  your  child  ever  report  when  he  has  earned  a 
Pt  C  or  L? 


Very  much 

some 

little 

k 

? 

0  8th 

12 

1 

0  7th 

9 

Yes 

No 

9 

1 

Yes 

No 

5 

1 

Gro 
Yes 


(P  1 


Group  2 
Yes  I"  No 
I  0 


Group  1 
Yos  1  No 


10 


Group  ? 
Yes  i  No 
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Coreor  Achievement  Skills  Training  Program  ^^ST  COPY  AVAILABLE 

Ouoctronnaire  for  Percnts  ...  - 

During  the  past  semester,  your  student  has  participated  in  the  Career  Achieven^cnl 
Skills  Training  (CAST)  program.   V/c  need  your  help  to  prepare  for  the  second  year 
of  our  proriram.   V/j^  wouta  fike  you  to  tc*[|  us  how  the  progrc«m  ha:;  helped  your  sen 

^r-    •J^.  ^  ..  r  V*     I.  '        -  ,  u   ..     .....  ^  .  u   ' 

Please  fiil  out  t\v3  Siccompcnying  queslionnair«.    Your  a:iswers  to  the  questions 

will  be  treated  confideritian y . 

Our  student's  scf-iool  is  

Our  student's  name  Is  

Please  put  your  cr:tnp!r  it-cl  questionnaire  in  the  accompanying  envelope.  Have 

your  student  teturr.  the  sealed  env^lopo  to  his  or  her  teacher.    It  will  L.o  sent  to: 

Judy  Battotischlng 
Director,  Project  CAST 
Irving  Eiement::ry  School 
Square  L,cko  Road 
Pontiac,  Michigan 
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Item  2.  Do  you  feel  that  you  have  become  more  involved  in  your  child' s  career 
exploration  since  his  or  her  participation  in  the  CAST  program? 

circle  one 

1.  Definitely  h    e  not  1-0 

2.  Probably  hav.?  not  2-3 

3.  Probably  have  3-7 

4.  Definitely  have  ^  ~  9 

Obvious  greater  involvement  indicated  by 
these  parents. 
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Item  3.    How  well  is  yovur  child  doing  in  his  or  her  career  exploration? 


Answer  the  question  twice: 


once  for  BEFORE  the 
CAST  program 
(before  Jan.,  1973) 

circle  one  BEFORE  CAST 


Once  for  SINCE,  the 
CAST  program 
(since  Jan. »  1973) 

circle  one  SINCE  CAST 


1.  very  poorly  1-0 

2.  poorly  2-8 
3*  well  5-6 
4.  very  v?ll  ^2 

Average  -  2.625 
Increase  from  less  than  **well"  to  better  than  **well**. 


1-  0 

2-  2 

3-  6 

^9 

Average  -  5»^11 


Item  k.    Read  statements  A  through  F  below. 

Then  select  1  of  the  5  answers  that  best  shows  how  nsuch  help  you  feol  your 
son  or  daughter  has  received  in  each  of  the  areas  A  through  F. 


Please  use  this  scale: 


1.  no  help 

2.  hardly  any  help 

3.  some  help 


Answer  the  question  twice: 


4.  a  lot  of  help 

5.  a  great  deal  of  help 


once  for  BEFORE  the 
CAST  program 
(before  Jan.,  1975) 

Circle  1  of  the  5 
BEFORE  CAST 


once  for  SINCE  the 
CAST  program 
(since  Jan.,  1975) 

Circle  1  of  the  5 
SINCE  CAST 


A.    Discovering  new  occupationsd 
possibilities  he  or  she  might 
look  into. 

3.    Getting  useful  information 
about  different  occupatiuns 

C.  Learning  to  make  logical 
step-by-step  choices 
between  occupations 

D.  Senir4g  connections  between 
iiis  or  her  values  and 
possible  occupations 


Avg. 
Avg. 


2.55 
2.53 


Avg.  -  2.15 


Avg.  -  2.55 


Avg. 
Avg. 


,00 
4.00 


Avij.  -  3.55 


Avg.  -  3»8 


E.    Seeing  connections  between  his 
or  her  school  experience  and 
future  pi  :  Avg. 


-  2.88 


Avg.  -  4.07 


F.    Learning  to  set  goals  and 
rnako  step-by-step  programs 
to  reach  those  goals 


Avg.  -  2.59 


Avg.  -  4.06 


Typical  increase  was  from  less  than  "some  help"  to  "a  lot  of  help"  in  each 
fo  the  six  areas. 
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Item  Do  you  feel  your  son  or  daughter  is  better  able  to  make  decisions 
about  his  or  her  future  as  a  result  of  participating  in  the  CAST  program? 


1. 
2. 


definitely  is  not 
probably  is  not 
probably  is 
definitely  is 


one 


5. 
4. 


2-  3 

3-  5 

^+-9 


Item  6,    Think  about  the  things  your  son  or  dauf^ter  has  done  to  explore 
careers  in  the  CAST  program.    List  3  things  that  he  or  she  has  done  at  home 
to  show  that  he  or  she  was  exploring  a  career. 


Lori  wants  to  be  a  nurse  so  there  resdly  isn't  much  she  has  done  at  home.  Her 
trip  to  the  hosp'' tal  was  postponed  and  as  yet  has  not  been  rescheduled.  She 
ic  lookinc  forward  to  it  very  much.    She  does  plan  on  being  a  candy  striper 
when  she  is  old  enouch. 

Bought  chemistry  set.    Reads  more  about  future  jobs.    Discusses  more  about 
future  at  hone. 

Discussion  with  pai-ents  about  a  teaching  career.    Rap  session  with  sister  who 
is  in  2nd  yr,  college  seeking  a  teaching  career  in  special  education.  Playing 
school  with  younger  brother  and  sister,  enjoying  the  teacher  role. 
Reading  books.    Asking  about  the  money  it  would  take  to  go  into  his  career.  How 
long  it  would  take  before  a  job  would  be  ready  after  he  finishes. 
Preparing  intolligiblo  questions  for  her  interview.    Talking  to  concerned 
neighbor  about  ht-.r  career.    She  did  have  a  complaint  about  the  career  she  wants, 
too  much  schooling. 

Reading  'norpital  bookr,  here  nt  hui;;e-.    Had  some  visits  with  a  R.N,    Had  (2; 
visits  wit!:  a  L.P.N. 

Talks  about  different  careers  she  would  be  interested  in.    Type  of  courses  she 
v/ill  bo  taking. 

Discussed  ncience  classes  that  she  may  need.    Spoke  of  her  field  trip.  Has 
become  consci'^^'s  of  grade  requirements  for  field  of  her  choice. 
Looked  up  different  careers  in  World  Book.      Discussed  with  parents  2  or  3^ 
ca-eer  possibilities  he  was  interested  in.    Told  in  detail  of  visit  to  police 
station.     It  wac;  field  trip  some  of  students  took.    He  was  very  impressed. 
Babysitting  and  learning  to  get  along  with  other  persons.    Talked  to  different 
people  about  their  job.    Learning  the  value  of  money  and  how  to  spend  it. 
Has  did  odd  jobr.  like  yards,  cars,  help  to  build  things.    Has  explored 
differences  possible  in  cars,  yards,  making  things  that  work.    Has  earned  his 
own  money  from  odd  job?. 


Wrote  for  infoimaticn  for  RN  and  LPN.    Reads  articles  and  asks  questions  -  same 
as  before.    Made  tour  of  hospital  difficult  at  this  age  to  get  on- job  look  at 
nursing  because  of  nature  of  profession. 

Got  ready  to  study  interview  at  airport.  Find  out  how  much  education  needed  fo 
jobs.    Qualifications  for  different  jobs. 

Conclusions 

Parents  talked  with  their  children  more  about  careers  after  taking  CAST 
than  before. 


1. 
2. 
3. 


CAST  PARENT  qUSSTIONNAIRE  COMMENTS  -  Item  6 


Sports. 
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ParentB  felt  that  their  children  had  been  helped  in  seeing  the  value 
and  in  being  given  the  steps  to  prepare  them  for  their  ceireer. 

Parents  were  more  involved  in  their  childrena*  c».reer  exploration  and 
planning  as  a  result  of  CAST. 
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CAST  Participant  Reactions 

On  the  followinc  page  are  reported  CAST  participant  responses 
to  a  series  of  questions  regarding  the  CAST  program.    The  purpose 
of  eecurinc  responses  to  these  questions  was  to  determine  how  the 
participants  viewed  the  CAST  prograw    -  past,  present  and  future. 
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Participant  Self  B>Port  Data 


1.  Where  (iid.  you  see  the  CAST  Progrflun  going  when  you  were  first  exposed  to  it 
during  training? 

Very  excited  about  using  skills  I  learned  (especially  attending,  responding  and 
ROPES)  in  classroom.    Thought  CAST  would  be  good  experience  for  students. 
Saw  great  possibilities*    Couldn't  do  sverything  wanted  to  because  lack  of  time 
and  later  lack  of  interest. 
I  didn't  know. 

Help  children  become  aware  of  career  possiblities. 

Designed  to  improve  ray  skills,  using  career  ed.  as  a  vehicle, 

St.  Basil's  training  program. 

As  a  unit  I  would  try  and  an  opportunity  to  better  my  own  skills. 
I  didn't  particulaa*ly  see  it  going  anywhere. 
I  did  not  seel 

Didn't  realize  it's  broad  applications. 

Following  the  trend  of  Career  Ed.  in  the  schools. 

I  thought  it  would  really  be  well  received  and  adapted. 

Pilot  project. 

Tried  once  or  twice  and  then  shelved.    Too  much  work  for  some  people. 

2.  Where  do  you  see  the  CAST  Program  going  now  that  you  have  been  involved  in  it 
for  a  year? 

Somewhat  disillusioned  since  teaching  CAST.    Students  not  turned  on,  lessons  dry. 
Program  needs  vitality. 

The  skills  have  implications  for  expansion  in  content  areas  and  a  min-course  of 
the  skills  and  objectives  in  the  CAST  to  be  taught. 

Greater  influence.  Skills  taught  to  children  can  be  applied  to  all  content  areas  - 
children  can  lead  other  teachers  and  students. 

If  funds  are  available  it  could  be  an  answer  for  many  bewildered  teachers. 

Same  place,  only  well  designed  to  keep  improving  my  skills. 

Students  should  learn  how  to  expand,  choose  and  act  on  decisions.    It  is  an 

important  process  of  maturing. 

Being  included  in  the  curriculum. 

Expanding. 

As  a  continuing  element  of  the  program  particularly  in  the  language  and  social 
studies  areas.    Also,  practical  arts  should  explore  it  in  part. 
I  see  it  becoming  an  integral  par-*"  of  the  curriculixra  so  that  students  can  make 
decisions,  develop  programs  which  directly  effects  their  lives  and  others, 
I  would  like  to  see  a  CAST  class  set  up  at  Madison  as  an  elective  with  the 
goal  being  that  the  student  will  go  on  an  internship  and  having  the  option  of 
continuing  the  expanding,  narrowing  process  during  the  last  part  of  the  class. 
Everywhere. 

Branching  into  any  number  of  areas  since  it's  so  well  integrated. 

Program  will  go  far.    It  helps  students  to  look  at  themselves  more  closely. 

I  think  it  has  to  be  modified,  if  it  will  be  expanded.    It  requires  a  lot  and 

I  don't  think  most  people  are  dedicated  enough  to  give  all  it  needs. 

School  district  wide  staff  development  CAST  delivered  district  wide  K-12. 

Continued  and  growing  vith  successful  people  being  trained  and  incorporated  in 

the  curriculiun  -  Language  Arts. 
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3,In  your  school  i  do  you  feel  the  CAST  Program  should  becorue  a  part  of  the 
curriculum? 


Maxiy  skills  worthwhile  for  students;  with  alterations  program  could  deliver 
skills  effectively. 

YeS|  but  delivered  in  a  shorter  block  of  time# 
Yes,  it  is  a  10-week  mini*course* 
Not  separately* 
Yes  -  12 
Yes  -  5 

I'd  like  to  see  it  integrated  into  curriculum* 
Language  Arts  -  3  week  block* 

k.  What  are  the  alternative  ways  of  getting  it  into  the  curriculum? 

Setting  up  as  a  specific  course. 

Soci''     Studies  unit  or  elective  as  a  mini-course* 

Integration  in  all  elementary  subject  areas. 

Guidance. 

Mini-course. 

I  would  like  to  sec  Language  Arts  Dept^  get  involved.    Social  Studies  could 

do  it  ^s  a  unit. 

To  tnake  it  a  new  subject. 

Survey  CAST  responsible  for  curriculum  to  determine  those  who  are 

interested  in  delivering  CAST. 

Ten  weeki  semesteri  full  year. 

Integrated  into  regular  curriculum. 

Have  one  teacher  teach  CAST  as  special  subject. 

Integrate  it  into  different  content  areas. 

Get  administrative  backing  and  more  help. 

Training  special  people. 

5.  Would  you  be  willing  to  deliver  the  CAST  Program  as  a  class  for  a  semester? 

a)  1  Perio^:  a  day  e)  5  Periods  a  day 

b)  2  Periods  a  day  f )  Not  at  all 

c)  5  Periods  a  day  g)  A  >week  unit 

d)  h  Periods  a  day  h)  Other 


a  -  3  -  0 

b  -  0  f  -  1 


c 


0  c  -  6 

d  -  0  h  -  ^ 

Comment 5 J    H  -  Intef^rate  daily 

Not  particularly  in  English 

1  period/day  for  10  weeks 
1  per  week 

A  6-week  course  taught  by  1  teacher^  5  hrs*  a  day 

a  -  0  e  -  0 

b  -  0  f  -  0 

c  -  0  E  2 

d  -  0  h  -  1 

h  -  Depends  on  where  I  ain. 
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6.  What  steps  would  be  necessary  to  include  CAST  in  the  curricxilum? 


Convince  the  principal  of  the  necessity.    Hire  a  teacher  to  specifically 
teach  CAST. 

Administration  support  and  needs  assessment  -  staff  involvement  and  ability  to 

appreciate  the  skills  taught. 

Train  other  teachers. 

Money  or  fit  into  Social  Studies. 

Principal  is  in  favor.    The  program  is  now  a  10-week  mini-course. 
Write  a  short  program  as  part  of  a  curriculum. 
Present  test  data  to  building  principal. 
Just  show  the  principal  how  to  fit  it  in. 

Greater  education  of  school  personnel.    Greater  level  of  funding,  millage, 
improved  teaching  circumstances. 

1.    Write  curriculum,  giving  ways  it  can  be  used  in  various  subject  areas.    2.  Get 

administrative  support.    3.    Get  principal  support,  Inservice  teachers. 

5»    Include  more  elemexitary  teachers. 

1.    Teacher  training.       2.    Administrative  support. 

An  official  comnunique  from  the  Director  df  CuiTiculum  to  place  it  in  the  Language 
Arts'-  Social  Studies  curriculum, 

7*  What  are  the  possibilities,  realities  or  obstacles  of  this  coming  about  in 
your  school? 

I  am  not  sure. 

Interested  persons  should  be  trained  (being  sure  to  include  INTEGRATION  idea  and 
not  just  "one  more  subject  to  squeer.e  in".)    Stress  value  of  skills  -  carry  over, 
Shakey. 

Other  teachers  also  need  background  training  in  the  delivery  of  CAST. 
Some  obstacles. 

Good,  since  we  have  people  trained. 
Money. 

As  a  curriculum  developer  for  part  of  the  math  curriculum,  I  see  a  need  for  the 
career  oC.np«jiient  becoming  a  part  of  our  curricula  and  could  push  for  that  in 
the  program  for  the  school  year  of '75- 
Very  possible. 

At  this  point  doesn't  look  promising.    Must  be  integrated  into  existing  program. 
V/ithout  someone  working-  on  above  items  (Q.  6)  (trainers)  not  very  good.    A  few 
teachers,  at  a  few  schools,  might  do  some  things,  but  it  wouldn't  be  systematic 
and  it  would  die  out,  soon. 

1.    Include  more  elementary  people  in  the  training.    2.    Direct  1  to  1  contact 
with  principals  via  trainers  or  administrators. 

It  would  be  approved  if  it  were  part  of  the  curriculum.    No  problems.  *'T" 
believes  in  CAST! 
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3,    How  successful  do  you  feel  you  were  in  delivering  the  goals  of  CAST  in 
terms  ofj 


a)  the  level  of  delivery  that  was  expected? 

b)  the  degree  to  which  your  students  learned  the  skills? 

c)  the  amount  of  time  you  had  to  deliver  the  program? 

d)  the  degree  to  which  you  understood  the  content? 

a  - 

I  feel  that  my  delivery  level  was  adequate,  but  I  had  hoped  for  much  better. 
Okay 

I  didn't  meet  my  personal  goal. 
Very 

I  wasn't  up  to  par. 

Good  Incomplete 

Yes 

Very 

Fair 

b  - 

I  feel  that  the  students  picked  up  many  of  the  e'dLlls  they  were  supposed  to, 

certainly  not  all. 

Fair 

Average 

Yes 

Mixed 

Average  to  above  average 

Avereige 

High 

My  delivered  probably  hampered  this  somewhat. 

Okay 

c  - 

oi^y  ^ .    . . 

X  had  a  target  teacher.    Time  was  somewhat  limited  and  not  enough  continuity 
delivering  once  or  twice  a  week. 

I  feel  I  was  hindered  by  the  fact  that  I  only  came  in  once  a  week  and  other- 
wise had  minimal  contact  with  the  class,  so  I  could  not  know  them, 
a  year 
Enough 
OK 
Good 
Yes 

Adequate 

Not  enough  because  of  building  assignment  delays, 
d  - 

Could  be  much  better 
Well 

I  have  a  much  better  understanding  now  than  when  I  began;  I  know  where  it's  going; 

I  did  not  havfj  a  thorough  understanding  of  that  before. 

Yes 

Good 

Well 

I-tediocre,  I  did  not  do  the  job  I  should  have. 
Better  as  the  year  progressed. 

I  did  not  understand  the  overall  content,  I  learned  and  understood  it  in 

pieces. 
Okay 
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Level  3 
Level  3 

b  - 

Level  5 
Level  3 
c  - 

Level  2 
Level  2 
d  ^ 

Level  ^ 
Level  k 

If  you  were  not  as  successful  as  you  woiJtld  have  liked  to  have  beeiif  please 
list  tiie  reasons  why# 

a)  Tliincs  that  you  could  have  done. 

b)  Things  that  others  could  have  done, 
a 

Revised  the  curriculum  to  make  it  more  relevant  to  the  student. 

I  was  involved  in  another  new  program  which  took  a  loxiQ  amount  of  time*    I  just 

could  not  have  squeezed  out  any  more  time  for  CAST. 

Taught  it  all  at  once. 

Paper  work  is  heavy.    I  should  consolidate  to  emphasize  most  important  aspects. 
Studied  program  to  become  familiar.    Planned  better. 

b  - 

Counselor  input  -  I  feel  he  did  a  great  job^  but  that  there  are  some  additional 
possibilities  that  could  be  developed. 

Helped  me  to  meet  deadlines.    Helped  me  to  see  the  total  perspective.  Give 
specific  answers  to  specific  qu'^stions  instead  of  spending  so  much  time 
exploring  with  me.    I  just  did  not  have  time  for  it. 
Helped  more  on  arranging  the  internships. 

Trained  us  or  given  us  moreknowledge  of  the  CAST  program^  before  we  were  asked 
to  teach  it. 
a  - 

Gone  into   tc-achers  class  more  often  for  delivery.    1.    Worked  with  him 
raore  at  beginning.    2.    Vtade  him  feel  it  was  more  him.    3.    Had  better 
classroom  managenent. 
b  - 

Explained  inport?.nce  of  project  to  building  principal  which  would  free  me  to  do 
more  CAST  delivery. 

1.    Target  teacher  could  have  been  better  prepared.    2.    Could  have  had  more 
principal  support. 
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Do  you  see  yourself  being  involved  in  the  CAST  Program  next  year? 

a)  to  what  extent? 

b)  Under  what  conditions? 

Yes  -  9 

If  I  am  in  Pontiac  I  would  consider  it. 
a  - 

Teaching  a  mini-course  on  careers. 

To  the  extent  that  I  can  fit  it  into  my  schedule  and  the  powers  that  be  intend 
me  to  be  a  part  of  it* 

Teaching  and  exposing  others  to  possibilities  of  CAST. 
In  HRD  training f  but  not  teaching  career  ed.  in  my  class. 
?.  hr.  per  day  in  10-week  mini-course ^ 

I  would  like  to  teach  the  revised  curriculum  and  help  with  other  writing  projects* 
In  one  block  of  time. 
Yes,  but  limited. 

Teaching  my  own  group  Sept.  -  June  and  spreading  the  working  to  encourage  others, 
b  - 

It  would  help  to  have  resource  person  or  aide  available. 
That  it  be  integrated  into  L.C. 

rieed  time.    Hope  for  more  source  materials  to  be  available. 

If  it  is  delivered  in  a  shorter  block  of  time  and  doesn't  interfere  with  my 

present  teaching  responsibility. 

Yes  -  3 
a  - 

Trainer,  if  needed 

Trainer 

Trainer 

b  - 

Millage  passes.    Administrative  support. 

I  will  need  to  be  in  a  position  in  the  district  which  will  allow  me  to  use  my 
skills  -  a  flexible  position  to  allow  time  for  training. 
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1.  What  grade  levelCs)  have  you  taught  the  CAST  curriculum? 

2-0         3-0        k-1      5-1     6-0     7-9      8-2      9-3     10-2     11-2  12-1 

2.  Was  ib  appropriate  for  that  level?  Yes  -  13        No  -  3 

3.  When  did  you  start  it?  72-73-3  73-7^-12  Both  -3 

At  what  level  do  you  feel  it  more  appropriate? 

2-3   >3   if-3   5-i+   6-5   7-10     8-10     9-11   10-8   11-6  12-6 

5.  Do  you  foel  there  is  a  need  to  have  Career  Education  in  the  Schools? 

Yes  -  17         No  -  0 

6.  If  yes,  how  woiild  you  rate  the  CAST  Program? 

Falls  short  of  -  1  is  adequately  -  7         Is  more  than  adequately  -  10 

...  meeting  the  needs  of  the  students. 

7.  Rate  the  following  program  components  in  order  of  their  importance  to  you  in 
delivering;  your  content  area  - 

(1  -  low       3  -  high) 


Interpersonal  Skills 

1- 

■0 

2-1 

3-17 

Career  Development  Skills 

1- 

■2 

2-7 

3-9 

Educational  Skills 

1- 

•1 

2'k 

3-lk 

Physical  Skills 

1- 

•  k 

2-7 

3-6 

8,    Rate  the  following  program  components  in  or^ler  of  their  importance  to  you 
in  delivering  the  CAST  program • 


Interpersonal  Skills 

1-0 

2-1 

3-17 

Career  Development  Skills 

1-0 

2-h 

■yih 

Educational  Skills 

1-0 

2-5 

3-15 

Physical  Skills 

1-5 

2-7 

5-8 

9*    Have  you  been  involved  in  other  career  education  programs?    Yes-8  No-10 

10»    If  yest  how  do  you  compare  this  program  to  the  other  which  you  have  been 
involved  in? 

CAST  far  surpasses* 

Head  and  DhoiJ.de rs  above  • 

This  is  best. 

Better  than  other  program* 

PCDP  8c  CCEK  -  This  is  a  better  program  because  it  is  more  systematic  and 
delivers  skills  to  students »  helpers  and  trainers.    CAST  has  been  incor- 
porated into  rny  present  program  •  Elementary  Career  Guidance  Consultant 
No  comparison  -  this  delivers  skills  CCEM  delivered  some  units* 
Better. 

Thif;  program  is  far  superior. 
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Conclusions 

Most  teachers  and  counselors  were  very  favorable  in  seeing  CAST  as 
a  necessary  part  of  the  school  curriculum  as  well  as  seeing  its  relation- 
ship to  their  own  content  areaa. 

Teachers  needed  help  in  seeing  how  they  could  integrate  CAST  with  their 
content  area.    Some  still  felt  they  have  to  »'leave  something  out"  to  make 
roora  for  CAS?. 

Teachers  felt  that  they  did  an  average  job  in  their  delivery  of 
CAST,    Many  said  that  they  did  not  understand  the  skills  in  the  beginning 
which  not  only  made  their  deliver  difficult  but  made  them  very  dependent 
on  the  lessen  plan  manual. 

In  total,  the  teachers  and  counselors  were  pleased  with  the  program 
smd  their  delivery,  but  recognized  room  for  improvement  in  both.  Having 
taught  the  program  once  G^ve  them  a  better  understanding  of  what  they 
could  have  done  differently  to  improve  their  delivery. 
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Reliability  Procedures 


Scorer  ard  Scoring  Reliability  Procedures 

The  instrumentation  used  in  this  project  waS|  for  the  most  part,  developed 
during  the  project  specifically  to  obtain  data  for  evaluation  and/or  assessment. 
As  a  result >  it  was  necessary  to  study  these  instruments  and  procedures  in 
an  effort  to  determine  if  they  were  yielding  reliable  data*    Several  techniques 
arc  available ^  most  of  which  require  large  groups »  control  groups »  repeated 
measures  and/or  parallel  tests.    Due  to  the  developmental  nature  of  this  project 
and  the  small  n^s  (for  staff  11,  trainers  7,  and  students,  six  classrooms) 
standard  procedures  are  not  viable.    None  the  less,  several  assessments  of 
instruments  stability  were  attempted.    Severail  correlation  coefficients  were 
obtained  from  two  or  more  administrations  of  the  same  instrument,  scoring 
and  rescoring  and  comparison  with  expert  ratings. 

Reliabilit:/-Tcacher 

For  the  teacher  assessment,  the  trainer  scores  were  compared  to  an  experts 
rating.    The  Pearson  correlation  ranged  from  0.^9  to  0«96  with  an  average 
of  O.S9.    Additional  analysis  of  the  scores  indicated  that  although  the 
correlation  was  high  the  individual  ratings  on  the  items  differed  significantly 
i.e.,  the  means  were  statistically  different  as  determined  by  a  t-test.  The 
trainers  gave  higher  scores  63%  and  lower  scores         of  the  time  when  com- 
pared to  the  expert. 

An  internal  reliability  check  was  also  made  which  in^Ucated  that  there  was  a 
fairly  high  internal  reliability  among  the  trainers.    The  correlation  between 
the  trainers  ranged  from  0^kj>  to  O.69. 

On  a  rate-rerate  study  the  trainers  showed  less  consistency  with  correlations 
ranging  from  -0.78  to  0.66.    In  7  out  of  9  cases,  the  first  rating  was  higher 
than  the  second,  indicating  some  systematic  changes  in  procedures  or  perception 
regarding  the  use  of  the  instrument  occurred* 

In  a  general  sense,  the  instrument  for  teacher  assessment  or  evaluation  tends 
to  show  some  reliability.    Unfortunately,  the  number  of  teachers  and  trainers 
involved  did  not  allow  for  detailed  study  and  therefore,  considerably  more 
refinement  is  needed  before  it  will  produce  reliable  enough  data  to  be  useful  as 
an  evaluation  tool. 
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Student  Assessment  Reliability 


Correlation  studies  were  made  to  determine  the  accuracy  and  consistency 
of  the  trainers  in  their  checking  of  the  student  post  test. 

The  correlations  between  the  scorers  »nd  the  ^xpert  scorer  ranged  from 
.71  to  .98.    The  data  reveals  a  tendency  for  the  scorers  to  be  consistently 
lo^^fer  than  the  criterion  rater.    However^  the  scores  are  not  different 
enough^  educationally  speaking,  to  in  any  way  negate  the  results  showing  the 
experimental  students  out-performing  the  control. 
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PALS  2VALUATIQN 


The  following  is  an  excerpt  from  the  PALS  project  evaluation  report.  The 
inclusion  of  this  report  is  made  on  the  grounds  that  the  curriculuin  used 
in  the  PALS  project  has  as  its  base^  the  CAST  Curriculun  I-bdel.  Alsot 
the  director  and  instructional  leaders  were  trained  in  the  CAST  program, 
delivered  CAST  during  Phase  II  of  the  project  and  served  as  trainers  during 
Phase  III*     In  an  effort  to  make  the  curriculum  irore  appropriate  for  senior 
high  school  and  the  PALS  project  goals ,  the  project  staff  made  modifications 
and  additions  to  the  curriculum. 


ERIC 


128 


Re;    Final  Evaluation  Report  -  PAIS  -  CAST  Pilot  Evaluation 


INTRODUCTION 

This  memorandum  will  report  the  results  of  a  pilot  evaluation  of  the  Pontiac 
Adult-Student  Learning  System  (PAI£)  Project.    Since  it  is  my  understanding 
that  the  students  in  the  PALS  project  received  the  Career  Achievement  Skills 
Training  (CAST)  curriculum,  evaluation  of  the  success  of  the  PALS  project 
indirectly  involves  an  assessment  of  the  effectiveness  of  the  CA^.X  curriculum. 
It  must  be  noted,  however,  that  this  evaluation  did  not  deal         ctly  with  CAST 
curriculum  as  a  separate  input  into  the  PALS  program.    A  descr  Lotion  of  the 
evaluation  design  and  its  limitations  will  be  followed  by  a  report  of  the  re- 
sults of  the  data  analysis.    Measurements  were  collected  on  several  aspects  of 
student  performance  in  the  test  situation,  a  simulated  job  interview  described 
below,  as  well  as  on  various  individual  background  characteristics.    We  must 
here  stress  the  pilot  nature  of  this  evaluation*    Our  aim  was  to  incorporate 
measures  of  several  aspects  of  subject  performance  with  a  relatively  small 
sample  size.    We  realize  that  only  gross  differences  will  be  apparent  but  it 
is  our  hope  that  these  differences  will  be  signposts  guiding  more  sophisticated 
and  complex  future  evaluations. 

PAI^  pilot  evaluation-variables  controlled 

The  decision  which  an  employer  makes  about  the  employment  of  an  applicant  is 
a  complex  one  in  which  several  factors  operate.    To  the  extent  possible  in 
this  limited  pilot  evaluation,  an  attempt  was  made  to  control  those  factors 
which  could  be  identified. 

Sex  To  eliminate  the  confounding  influence  of  the  gender  of  the  applicant 
on  Doth  performance  in  the  interview  and  on  the  interviewer's  decision  to 
hire  the  applicant,  only  female  subjects  were  selected.  Females  were  chosen 
rather  than  males  because  in  the  groups  from  which  subjects  were  selected 
there  were  too  few  males.  The  relatively  small  number  of  males  may  suggest 
that  gender  operates  as  a  factor  in  the  trainees*  self  selection  with  the 
program  and  on  the  ultimate  performance  of  the  trainees.  In  future  eval- 
uations, it  is  suggested  that  the  performance  of  both  male  and  females  be 
examined. 

School  The  PALS  project  is  in  operation  in  the  two  Pontiac  Senior  High 
Schools.    To  avoid  the  confounding  influence  of  the  contextual  effects 
of  the  different  buildings,  only  those  trainees  in  Pontif^c  Northern  High 
School  were  selected  for  inclusion  in  the  pilot  evaluation.    A  more  am- 
bitious evaluation  would  examine  whether  or  not  there  are  between-build- 
ing differences  in  PALS. 
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Grade  In  order  to  limit  posf^ible  age  grade  differences  and  differences  in 
motivational  level  of  subjects,  selection  was  made  from  lists  of  tenth  grade 
feuialcs  ,    SubscqU  ini        it  was  discovered  that  two  (2)  of  the  participants 
in  the  research  xv'^ere  eleventh  graders.    However^  inspection  revealed  no  ap- 
parent differences  related  to  age# 

Trainer  There  are  threa  PAI-S  trainers.    Clearly  each  probably  conducts  the 
training  somewhat  differently.    This  evaluation  did  not  measure  inter-trainer 
differences.    The  subjects  were  selected  from  one  trainer  only.    The  extent 
of  the  differences  produced,  if  any,  by  different  trainees  is  left  to  future 
evaluations. 

Interviewers  Two  professional  personnel  interviewers  from  the  Pontiac  School 
System  interviewed  the  subjects  in  this  evaluation.    Our  decision  to  use  these 
men  was  based  on  the  assumption  that  since  they  worked  in  the  same  system,  they 
would  use  s?.milar  criteria  in  deciding  whom  to  hire.    Analysis  of  the  results 
fails  to  yield  any  evidence  of  systematic  differences  between  them.    Interviewer  1 
conducted  interviews  with  significantly  fewer  verbal  interactions  than  Inter- 
viewer'2  (rf  -*613,  pc^^OOl)*  and  subjects  interviewed  by  Interviewer  1  tended  to 
say  more  (a  higher  number  of  subject  responses)  than  those  seen  by  Interviewer  2 
#533,  p<^.01).     In  addition,  students  interviewed  by  Interviewer  2  were  sig- 
nificantly more  likely  to  rate  him  higher  on  ••attending**  behavior  (viz.,  "leaning 
forward"  toward  subject)  than  were  subjects  interviewed  by  Interviewer  1  (r^'  -.769, 
p^.OOl).  No  other  differences  were  observed.     In  short,  our  assumption  that  by 
using  professional  personnel  interviewers  we  would  be  able  to  standardize  the 
quality  of  the  interview  situation  which  the  subjects  confronted  does  not  seem 
to  have  been  contradicted  in  our  data.    We  conclude  that  there  is  no  reason  to 
believe  that  there  was  any  significant  difference  in  the  behavior  of  the  inter- 
viewers . 

Job  foils  Subjects  were  informed  that  they  were  to  apply  for  jobs.    Two  jobs 
(See  Appendix  A.l  and  A,2)  were  presented  to  the  subjects  as  foils:  Summer 
office  assistant  and  counselor-helper.    These  jobs  were  selected  for  two  reasons. 
First,  a  relatively  low  level  of  skill  was  required  for  either  job  so  that  sub- 
jects would  be  less  likely  to  be  discouraged  because  of  skills  required.  Second, 
each  job  represents  a  different  interest  perspective:    The  summer  office  assis- 
tant was  directed  at  those  subjects  interested  in  "things*';  the  counselor-helper 
was  designed  to  appeal  to  those  subjects  interested  in  ••people'*.    By  utilizing 
these  job  foils  our  hope  was  to  hold  relatively  constant  the  two  important  fac- 
tors in  job  choice  -  skill  and  interest  level. 

Payment  of  subjects    All  subjects  were  paid  $2.50  for  their  participation 
in  the  evaluation.    Tlie  decision  was  n.v^de  in  favor  of  uniform  remuneration  since 
it  was  thought  that  this  procedure  would  give  additional  credibility  to  the  dis- 
guise described  below. 

*  Interviewer  1  was  assigned  a  value  of  "1"  and  Interviewer  2  a  value  of  ••O*' 
for  their  analysis.    Product  moment  correlation  coefficients  were  produced  for 
the  relationships  between  this  "dummy  variable**  and  the  others  measured. 
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Race  The  racial  composition  of  the  student  partiuipants  was  mixed.    Of  23 
subjects,  9  were  lirted  as  *Vhite,*'  13  as  ''black/'  and  1  as  '^Latino."  The 
relationships  between  raca  and  the  dependent  variables  under  iuspoction  were 
examined.*-     Examination  of  ther.e  relationships  revealed  that  altho  nou-whito 
subjects  tended  to  rate  interviewer  reaction  to  them  lower  (r^  -•457,  p<f*02) 
than  white  subjects  and  white  subjects  tended  to  do  more  preparation  for  the 
interview  situation  than  non-whites  (r=  .378,  p  <^  ^05)  ^  no  racial  differences 
were  found  on  interview  related  variables, 

PALS  pilot  evaluation  -  test  situation  and  variables  measured 

A  primary  focus  of  this  pilot  evaluation  was  overall  effectiveness  of  the 
PALS  program  (and  indirectly,  the  CAST  curriculum)  in  training  its  recruits  to 
perform  well  in  an  employment  interview  situation*    Therefore,  the  test  situation 
involved  a  siimilated  job  interview  in  which  subjects  would  apply  and  be  considered 
for  fictitious  jobs.     In  general,  it  was  thought  that  the  simulated  job  interview 
provided  an  arena  where  PALS -imparted  skills  could  be  tested  under  field  condi- 
tions ♦ 

In  order  to  minimize  the  potential  bias  introduced  by  the  individual's  per- 
sonal involvement  in  the  PALS  project,  an  attempt  was  made  to  disguise  the 
fact  that  what  was  being  evaluated  was  the  PALS  project*    Subjects  were  in- 
formed that  an  evaluation  of  interview  techniques  was  being  conducted.  (See 
Appendix  B) .    They  were  asked  to  participate  in  this  evaluation  by  "going 
through  a  pretend  job  interview/'    Our  intention  was  to  focus  the  subject's 
attention  on  the  interview  itself  and  distract  them  from  concentrating  on 
their  performance* 

The  interviewers  were  "blind**  to  which  subjects  were  PALS  trainees  and  which 
were  not.    They  were  asked  to  evaluate  subjects  for  employment  using  the 
criteria  which  they  habitually  use  to  make  these  kinds  of  decisions.  To 
facilitate  their  task,  the  standard  employee  rating  chart  used  in  the  Pontiac 
Schools  was  modified  for  use  in  this  evaluation.     (See  Appendix  C) . 

In  addition,  the  interviewers  were  also  asked  to  rate  the  applicant  on  the 
PALS-related  dimensions  of  '^responding"  and  "attending."     (See  Appendix  D). 
These  ratings  were  to  be  accomplished  after  the  interviewer's  other  eval- 
uation of  the  candidate  was  completed.     In  debriefing;  the  interviewers,  a 
problem  with  this  procedure  became  apparent »    Having  the  interviewer  rate 
the  applicant  on  PALS  dimensions  alerted  the  Interviewers  to  "fingerprints" 
of  the  PALS  program  and,  consequently,  enabled  them  to  identify  which  subjects 
were  PALS  trainees.    One  interviewer  stated  he  could  identify  PALS  trainees 
by  the  way  they  sat.    The  value  of  having  interviewers  rate  on  PALS  criteria 
would  seem  outweighed  by  the  contarain^i.tion  which  identification  of  the  PALS 
trainees  introduces. 


*  Race  was  converted  into  a  "dununy  variable"  with  "white"  coded  as  "1"  and 
"Non -white"  coded  as  "0". 
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Each  interview  was  observed  and  rated  by  a  trained  PALS  observer  whose 
responsibility  it  was  to  rate  the  levels  of  '^responding"  of  both  the  sub- 
ject and  the  intorvievjer  and  the  level  of  "attending"  of  the  subjects  (See 
Appendices  E  and  F) .    "Responding*'  was  rated  on  a  three-point  scale:  "1" 
was  scored  if  the  subject  was  "inaccurate,  takes  awo^y  from  what  is  said"; 
*'2"  v^as  scored  if  the  subject  "tries  to  clarify  but  misses  most  of*  con- 
tent*; and  "3"  was  scored  if  the  subject  was  "able  to  clarify  what  the  inter- 
viewer is  saying."    Each  individual  response  was  rated  on  the  "responding" 
dimension^    "Attendinj;"  was  rated  on  a  five-poinr  scale  which  scored  the 
subject  ''V  if  he  paid  no  attention  to  "5"  for  optimal  attention.    For  each 
third  of  the  interview,  the  subject  received  an  "attending"  rating* 

Finally, the  subjects  themselves  were  asked  to  rate  both  their  own  and 
the  interviewer •s  perfoirmaace.    After  completing  the  interview,  subjects 
were  asked  to  complete  a  questionnaire  including  items  measuring  the  levels 
at  which  they  perceived  the  interviewers  "responding"  and  "attending"  as  well 
as  their  own  "responding"  and  "attending"  levels*     (See  Appendix  G) .  Their 
data  will  not  be  extensively  analyzed  for  this  report.    However,  we  note  that 
all  the  subjects  perceived  the  interviewer  as  being  "very  interested'*  and 
every  subject  saw  herself  as  "very  interested"  in  the  inteirview*    This  would 
seem  to  indicate  u  generally  favorable  reaction  to  the  test  situation. 


Selection  of  subjects 


Although  this  pilot  evaluation  design  does  not  incorporate  a  control  group 
in  the  strict  sense,  some  attempt  was  made  to  select  a  Non-PALS  group  for 
the  purposes  of  comparison*    It  must  be  boime  in  mind  that  the  lack  of  a 
control  group  severly  limits  the  amount  of  confidence  which  can  be  placed  in 
comparative  statements.    Bearing  in  mind  this  limitation,  we  shall  describe 
briefly  the  selection  of  subjects  from  PALS  and  a  roughly  comparable  non-PALS 
population. 

The  availability  of  a  group  of  tenth -grade  females  at  PNHS  to  whom  objec- 
tive tests  were  administered  (similar  tests  were  also  administered  to  PALS 
trainees  but  their  data  are  not  yet  available)  allowed  us  to  select  20  sub- 
jects whose  interests  were  comparable  to  the  PALS  females.    Twenty  names 
were  selected  at  random  from  a  list  of  33  of  these  high  school  students* 

Northern  High  School^ s  section  of  the  PALS  training  program  included  25 
females  of  which  a  random  20  were  chosf^n  for  inclusion. 

These  40  subjects  were  than  randomly  assigned  to  the  two  interviewers.  Of 
the  40  possible  interviews,  23  were  completed  yielding  the  following  design: 

PALS  NOT  PALS  '  TOTAL 

INTERVIEWER  15  5  10 

INTERVIEWER  2  7  6  13 


TOTAL  12  11  23 

The  results  from  this  design  are  described  on  following  page. 
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Findlnga 


This  report  will  present  the  results  of  an  analysis  of  the  data  gathered  in 
this  evaluation.     In  addition  to  a  disctission  of  those  variables  which  were 
directly  under  scrutiny,  i.e.,  PALS-related  variables,  excensive  data  on  the 
characteristics  of  the  individual  subjects  will  be  presented.    Our  major  find- 
ing In  this  analysis  is  that  these  background  variables  do  not  seem  to  be 
significantly  related  to  outcome. 

PALS -training  as  a  predictor  of  Job  interview  performance 

Subjects  hired  The  interviewers  were  instructed  to  hire  no  more  than  half 
the  applicants  whom  they  interviewed.    Slightly  less  than  half,  ten  appli- 
cants, were  hired.    As  Table  1  demonstrates,  PALS  training  would  seem  to 
be  an  asset  In  performing  well  in  the  interviews. 

TABLE  1 

RELATIONSHIP  BETWEEN  TRAINING  RECEIVED 
AND  DECISION-TO-HIRE  FOR  PAI£ 
PILOT  EVALUATION 

HIRED  NOT -HIRED  TOTAL 

PALS  TRAINED  9  3  12 

NOT  PALS  TRAINED  1  10  11 

TOTAL  10  13  23 

2    =  7.64      P  <  .005 

X 

Nine    of  the  ten  applicants  who  were  "hired"  were  PALS  trained.    In  other 
words,  the  PALS  trainees  had  two  chances  in  three  of  being  successful  whereas 
the  subjects  who  were  not  in  VMS  program  had  less  than  one  chance  in  five. 
The  relationship  appears  significant  and  therefore,  we  have  no  reason  to  be- 
lieve, from  these  data,  that  TALS  is  not  effective  in  training  subjects  to 
perform  well  in  job  interviews. 

Interviewer  rated  subject  behavior.    In  addition  to  making  a  summative  judg- 
nient  about  hiring  or  not  hiring  the  subject  being  interviewed,  the  interviewers 
using  their  standard  rating  form  (see  Appendix  C),  also  scored  the  student 
applicants  on  other  aspects  of  their  presentation  of  self  during  the  session 
and  rated  subjects  on  PALS-related  bghavior  (see  A{'pendix  D) .  Each  of  the  no- 
Biinal  categories  was  assigned  a  numerical  value,  assuming  an  ev-jual  interval 
scaLi  and  means  were  computed  for  the  PALS -trained  and  "control"  groups.  For 
example,  on  the  interviewers  rating  sheet  which  appears  as  Appendix  C,  the 
descriptive  terms  listed  next  to  the  series  of  "personal"  characteristics  were 
coded  as  follows:  "slovenly"  »  1;  "careless"  =  2;  "appropriate"  »  3;  "tasteful" 
4:  and,  "smart"  =  5.    The  corresponding  code  numbers  for  all  the  nominal  cate- 
gories are  recorded  on  the  forms  in  the  Appendices.    The  results  of  the  analysi 
of  this  set  of  means  appears  in  Table  2, 
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TABLE  2 


MEAN  SCOI^  FOR  I'ALS -TRAINED  AND  »' CONTROL" 
GROUPS  ON  INTERVIEWER-RATED  BEHAVIORS 

Mean  Scores    Mean  Scores 
for  for 


PALS -CAST         CONTROL         DIFFERENCE  t 


Interviewer's  Rating  of  Student's 

"Dress,  Grooming,  Etc."  3.67 

Interviewer's  Rating  of  Student's 

"Voice"  A.  33 

Interviewer's  Rating  of  Student's 

"Use  of  English"  3.83 

Interviewer's  Rating  of  Student's 
"Physical  Health -Vigor"  4.25 

Intexn^iewer's  Rating  of  Student's 
"Personality"  4.17 

Interviewer's  Rating  of  Student's 

"Mental  Reactions"  4.17 

Interviewer's  Rating  of  Student's 

"Social  Poise"  4.00 

Interviewer's  Rating  of  Student 

Interest  During  Interview  3.00 

Interviewer's  Rating  of  Student's 
Feedback  During  Interview  2,90 

Interviewer's  Rating  of  Student's 
Organization  2.90 

Interviewer's  Overall  Evaluation 

of  Student's  Performance  3.42 


2.80 
2.89 
3.00 
3,20 
2.90 
3.00 
3.11 
2.40 
2.50 
1.90 
2.50 


,87 
1.44 
,83 
1.05 
1.27 
1.17 
.89 
•  60 
.40 
1,00 
.92 


3.15** 

4.62** 

2.80** 

3.91** 

4.07** 

3.92** 

3.04** 

3.67** 

1.81* 

3.40** 

1.96* 
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*  Significant  at  .05 
**  Significant  at  .01 
NS    Not  Significant 
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The  results  of  the  analysis  presented  in  Table  2  displays  that  on  every 
variable  rated  by  the  interviewer,  PALS-trained  subjects  score  significantly 
higher  than  the  •^contror*  subjects.    As  reflected  in  those  ratings,  PALS 
subjects,  on  the  average,  were  better  "groomed,"  used  their  "voice"  and 
"English"  better,  wore  in  better  "physical  health,"  had  more  pleasing  "per- 
sonalities," better  "mental  reactions,"  greater  "social  poise,"  were  more 
"interested"  during  the  interview,  were  more  "responsive"  to  the  interviewers* 
comments,  and  were  better  "organized."    It  is  not,  therefore,  surprising  that 
when  overall  evaluation  is  expanded  from  a  simple  "employ  -  not-employ"  situ- 
ation to  include  other  ratings,  PALS -trained  subjects  are  likewise  signifi- 
cantly higher  than  the  "control"  subject;s#    A  sign  test  on  the  pattern  of  re- 
sults shows  that  the  probability  of  achieving  the  pattern  of  significant  dif- 
ferences which  appears  in  Table  2  by  chance  is  less  than  1  in  one  hundred. 
Clearly,  PALS-training  seems  to  enable  its  subjects  to  achieve  high  ratings 
on  these  interviewers  rated  characteristics.    To  the  extent  that  these  high 
ratings  in  the  simulated  job  interview  situation  are  indicative  of  ability 
to  perform  well  in  such  situations  in  the  real  world.    PALS  training  seems 
effective* 

The  apparent  strength  of  the  relationship  between  PALS  training  and  success- 
ful performance  in  the  simulated  interview  is  attenuated  because  of  two  fact- 
ors which  are  inherent  in  the  design  of  this  pilot  evaluation*    First,  although 
the  members  of  comparison  group  did  not  receive  the  PALS  subjects  (sex,  grade,  hljh 
school),  we  cannot  be  confident  that  the  females  in  the  comparison  group  are 
not  different  on  some  other  important,  but  unmeasured,  variable.  Specifically, 
since  self -s<*lection  seems  such  an  important  element  in  the  PALS  program,  we 
cannot  rule  out  the  possibility  that  the  factor  which  leads  studeuL^i  to  choose 
PALS  Is  the  same  characteristic  which  contributes  to  their  good  performance* 
A  more  complex  design  is  necessary  to  eliminate  this  possibility.    Second,  as 
was  described  above,  we  cannot  rule  out  the  possibility  of  contamination  due 
to  the  ability,  or  supposed  ability,  of  the  Interviewers  to  discriminate 
between  PALS  and  non-PALS  subjects.    Tlie  failure  of  the  "blind"  condition 
raises  a  question  about  the  ability  of  PALS  trainees  to  perform  well  on  criteria 
other  than  those  provided  by  Lae  program  itself.    The  "clues"  to  PALS  criteria 
may  have  introduced  some  bias  into  interviewers*  selections  for  hiring.  Whatever 
the  direction  of  possible  bias,  a  more  sophisticated  design  is  required  to  reduce 
the  possibility  of  contamination  from  these  factors* 

Finally,  the  strength  of  the  pattern  which  appears  in  Table  2  derives  from  the 
strength  of  the  interrelationships  among  the  interviewer  ratings ♦    There  is  no 
reason  to  believe  that  the  ratings  on  "personal"  characteristics  are  indepen- 
dents   The  average  product -moment  correlation  of  the  ratings  cn  "personal" 
characteristics  and    overall  evaluation    is  .674  and  all  ten  of  the  correlation 
coefficients  are statistically  significant.    More  research  is  required  to  isolate 
orthogonal  dimensions  in  the  rating  situation  and  to  compare  PALS -trained  and 
"control"  groups  on  these  dimensions.    A  preliminary  examination,  by  means  of 
linkage  analysis,  of  the  internal  clusters  in  these  dat .  "eveal  three  clusters 
of  variables;  (1)  physical  vigor,  personality,  mental  reactions  &  voice;  (2) 
dress  and  grooming,  use  of  English  and  social  poise;  and  (3)  overall  rating  by 
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interviewer,  the  level  of  subject  interest  and  organisation  and  the  quality 
of  his    feedback"  to  tho  interviewer*    This  analysis  suggests  that  first,  these 
clusters  may  be  the  orthogonal  factors  operating  in  the  interview  situation 
and,  second >  overall  evaluation  is  more  associated  with  PALS  training  than 
with  social  appearance  iteras.    More  sophisticated  analysis  on  a  larger  number 
of  interviews  is   -<  quired  to  trace  out  these  factors •    Such  analysis  would 
yield  clues  to  the  operating  dynamics  in  the  intexrview  situation  which  lead 
directly  to  "hiring*^  decisions  and  this  information  could  be  fed  back  into 
the  training  regimen  of  stibjects. 

In  summary »  to  the  extent  that  the  interviewer  ratings  of  applicants  in  a 
simulated  job  interview  situation  measure    the  ef f ectivensss 
of  PALS  training  and  to  the  extent  that  the  data  generated  here  accurately 
reflect  the  process  of  job  interviewing,  we  conclude  PALS  training  does  produce 
more  effective  performances  in  an  employment  situation.    Within  limits  of 
the  caveats  entered  above,  the  PALS  program  seems  successful  in  meeting  that 
part  of  its  objective  of  preparing  students  for  the  world  of  work. 

Subject  rated  interviev7er  behavior >    Subjects  were  also  asked  to  rate  the 
performance  of  their  interviewers  during  the  test  situation  (see  Appendix  G) • 
In  addition  to  maintaining  the  experimental  "cover,*'  we   hoped  to  determine 
whether  PALS  training  increased  subject  sensitivity  to  the  interview  situation* 
However,  no  differences  were  discovered  in  the  ratings  given  by  subjects.  (Data 
not  presented ♦)    We  are  reluctant  to  conclude  that  these  no  findings  simply 
reflect  lack  of  differential  sensitivity  among  subjects.    Other  factors,  such 
as  the  setting  of  the  experiment  and  the  way  in  which  the  subject  ratings  were 
collected  may  explain  the  lack  of  variance  in  their  responses ♦ 

Observer  rated  interview  behavior >    A  final  measure  of  behavior  during  the 
simulated  job  interviews  was  obtained  from  observers  who  were  placed  in  the 
interview  room.    These  observers  were  asked  to  rate  both  Interviewer  and  ap- 
plicant on  a  number       PALS-related  criteria  (see  Appendices  E  and  F) •  The 
results  of  these  ra.   ^^gs  appear  in  Table  3. 

The  data  in  Table  3  reveal  that  in  all  instances  of  observer  rating  of  subject- 
controlled  behavior,  PALS -trained  students  score  significantly  higher  than  do 
tho:::e  students  chosen  as  "control.*'    PALS  trained  students  have  significantly 
more  verbal  responses  and  "attend"  at  a  consistently  higher  rate  throughout  the 
interview  situation*    Only  on  those  observer  rated  behaviors  over  which  the 
Interviewer  had  control,  total  nuxober  of  verbal  interactions  and  mean  number 
of  interviewer  verbal  responses,  do  no  significant  differences  appear.  This 
Is  what  we  would  expect  since  we  assumed  that  interviewer  behavior  would  be 
standardized  for  PALS -trained  and  "control"  subjects. 

In  terms  of  subject  performance,  observer  ratings  display  a  consistent  and 
strong  pattern  of  superiority  of  PALS-trained  subjects.    On  the  basis  of  these 
data,  we  conclude  that  PALS -training  is  effective  in  imparting  the  skills  of 
"responding"  and  "attending •" 
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TABLE  3 


MEAN  SCORES  FOR  PALS -TRAINED  AND  "CONTROL" 
GROUPS  ON  OBSERVER  RATED  BEHAVIORS 

Mean  Scores    Mean  Scores 


for 
PALS -CAST 


for 
CONTROL 


DIFFERENCE  t 


Number  of  Verbal  Interactions 

During  the  Interview  14,08 

Number  of  Student  Responses 

During  Interview  2.08 

Number  of  Interviewer 

Responses  During  Interview  1.97 

Rate  of  Student  "Attending"  During 

First  Third  of  Interview  3,07 

Rate  of  Student  "Attending"  During 

Second  Third  of  Interview  3.03 

Kate  of  Student  "Attending"  During 

Final  Third  of  Interview  3.03 

Mean  Student  "Attending"  Rate 

During  Interview  3,04 


12.18 
1.51 
2,16 
2.32 
2.36 
2.27 
2.32 


1.90 
.57 

-.19 
.75 
.67 
.76 
.72 


NS 

3.89** 
NS 

2.08* 
1,72* 
2,07* 
2.01* 


*  Significant  at  ,05 
**  Significant  at  .01 
NS    Not  Significant 
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Background  chviractertstlcs  of  PALS -trained  and  "control"  groups* 


With  the  permission  of  the  Director  of  Student  Guidance  and  Personnel  of  the 
Pontiac  Public  Schools,  the  cummulative  records  of  the  student  subjects  were 
examined  and  various  data  on  background  characteristics  were  coded.  Table  4 
presents  a  sumniary  of  these  data  for  PALS -trained  and  "control"  subjects. 

TABLE  4 

MEAN  SCORES  ON  BACKGROUND  VARIABLES 
FOR  PALS -TRAINED  AND  "CONTROL"  SUBJECTS 

Mean  for        Mean  for 
PALS -Trained     "Control        Difference  t 

MICHIGAN  EDUCATIONAL  ASSESSMENT 

M.E.A.P.  Vocab  Score                               50.18             46.43  3.55  NS 

M.E.A.P.  Reading  Score                            52.64             46.71  7.07  NS 

M.E.A.P.  Math  Score                                 45.55              45.57  -.02  NS 
M.E.A.P,  Comprehensive 

Achievement  Score                                    49.60             46.57  3.03  NS 

COMPREHENSIVE  TEST  OF  BASIC  SKILI^ 

C.T.B.S.  Reading  Vocabulary  Score           32.40              26.44  5.96  NS 

C.  T.B.S,  Reading  Comprehension  Score      39.40              24,78  14.62  NS 
C^T.B.S.  Total  Reading                            22.67              21.22  1.45  1.77* 

DIFFERENTIAL  APTITUDE  TEST 

D.  A.T.  -  VR  35.00  35.14  -.14  NS 
D.A.T.  -  NA  28.64  32.71  -4.07  NS 
D.A.T.  -  VR+NA  29.09  36.00  -6.91  NS 
D.A.T,  -  Abstract  Reasoning  45.00  48.29  -3.29  NS 
D.A.T.  -  Spatial  Relationships               41.36             46.57  -5.21  NS 

METRQPOLrTAN  ACHIEVEMEOT  TEST 

M.A.T.  -  Total  Reading                            34.18              25.78  8.40  NS 

M.A.T.  -  Total  Math                                36.18             30.44  5.74  NS 

Grade  3  IQ                                            104.10             93.57  10.53  NS 

Number  Grades  Father  Completed               10.18             9.63  .55  NS 

Number  Grades  Mother  Completed               10.00             11.13  -1.13  NS 

Mean  GPA  Last  Term                                 2.82               2.30  .50  NS 

^  J.'gnificant  at  .05 

NS  Nov  Significant 
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It  Is  clear  from  an  examination  of  the  data  in  Table  A  that  there  are  no  syste- 
matic differences  between  PALS-trained  and  ''controT'  subjects  which  might  ex- 
plain the  success  of  PALS -trained  subjects ♦    On  only  one  of  the  several  test 
scores  available^  the  Comprehensive  Test  of  Basic  Skills  Total  Reading,  is  sig- 
nificant difference  observed;  no  differences  worth  noting  appear  between  PALS- 
trained  and  '^contror*  subjects  in  terras  of  GPA,  IQ  or  parents*  education.  We 
have  reason,  therefore,  to  believe  that  differences  in  perfonrance  can  better 
be  accounted  for  by  PALS -training  than  by  other  variables •    Of  course >  in  this 
analysis »  only  bivariate  statistics  were  computed.    The  excremely  small  number 
precluded  multivariate  tests  which  would  have  enabled  the  testing  of  the  im- 
portance of  second -order  effects, 

PAI^ -related  behavior  and  '^hiring"  of  subjects 

The  data  presented  above  demonstrate  that  the  PALS  program  seems  to  effectively 
train  its  subjects  in  the  appreciation  of  particular  skills.    A  final  question 
is  what  relationship  exists  between  these  skills  and  the  decision  to  employ* 

The  measured  ?Al£  criteria  seem  to  discriminate  between  ^^hired**  and  non- 
•'hired*'  groups.    Table  5  presents  the  comparisons  betwe.  ,  the  two  groups.  Ins- 
pection reveals  that  those  subjects  who  were  "hired"  responded  at  a  significantly 

TABLE  5 

COMPARISON  BETWEEN  '*HIRED"  AND  NOT -"HIRED" 
GROUPS  ON  PAI5-REIATED  CRITERIA 

"NOT 

"HIRED'^      HIRED"         DIFF>  t 

MEAN  "RESPONDING"  RATING 

OF  SUBJEdS  2.11         1.53  ,52  9*83  t  •9995-3.82 


MEAN  "ATTENDING"  RATING  OF 

SUBJECTS  3*12         2.58  ^54  3.58  t  •995«2.83 


higher  level  than  those  who  were  not  '*hlxed."    Therefore,  it  seems  that  the 
ability  of  the  subject  to  demonstrate  her  understanding  of  what  the  interviewer 
is  saying  is  a  factor  in  successful  performance • 

Likewise,  the  average  "attending"  rating  of  those  subjects  who  were  judged 
employable  by  the  inteiviewers  is  significantly  higher  than  the  average  of 
those  who  failed  to  impress  the  employers  in  the  simulated  interview*  On 
the  basis  of  these  data  it  would  seem  that  the  skills  involved  in  paying 
attention  during  the  interview  do  make  a  difference  in  the  Job  seeking  arena. 

We  conclude  that  the  PALS  program  is  justified  in  stressing  the  skills  of 
"responding"  and  "attending"  since  both  these  behaviors  seem  to  make  a  sig- 
nificant difference  in  discriminating  between  levels  of  success  in  this  pilot 
evaluation.    The  strength  of  our  findings,  however,  must  be  tempered  by  our 
reliance  on  the  simple  comparisons  dictated  by  an  extremely  small  n.  More 
conclusive  results  require  a  more  complex  design^ 
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Conclusions 


Our  pilot  evaluation  leads  us  to  several  conclusions  which  shall  be  presented 
in  this  final  section # 

1.  The  simulated  job  interview  seems  to  be  a  workable  procedure  for  producing 
a  global  evaluation  of  the  performance  of  subjects  as  well  as  for  providing  an 
arena  in  which  more  subtle  measures  can  be  collected.    The  interviewers  and  the 
subjects  seemed  comfortable  operating  in  this  setting  and  no  adverse  reactions 
were  detected.    The  presence  of  an  obsexrver  during  the  inteirview  enabled  us 

to  collect  observational  data  which  can  be  related  to  the  attitudinal  data 
provided  by  both  subject  and  interviewer  and  seemed  to  impose  no  '^erious 
burden  upon  the  interview  process  itself.    Analysis  of  dat  on  interviewer 
performance  indicates  that  professional  personnel  interviewers  do,  by  and 
large,  standardize    behavior  with  respect  to  various  sub-groups  of  subjects ♦ 
By  using  such  personnel,  it  would  seem  possible  to  present  the  subject  with 
a  relatively  constant  situation  and,  thereby,  to  minimize  interviewer  effects. 
Of  course,  with  a  larger  n,  such  effects  could  be  tested  more  systematically. 
In  our  pilot  evaluation,  such  a  test  was  not  feasible.    Another  reservation 
involves  the  use  of  rating  scales  based  upon  PALS  criteria  by  the  interviewer 
since  exposure  to  such  scales  may  alert  the  rater  to  "fingerprints"  of  PALS 
trainees  and,  thus,  contaminate  the  results. 

2.  PALS  seems  to  be  stressing  criteria  which  are  relevant  to  successful  per- 
formance in  an  employment-seeking  situation.    Despite  the  fact  that  inter- 
viewers used  their  standard  criteria  in  arriving  at  a  final  decision  to  "hire" 
or  not-to-"htre"  the  applicant,  both  PALS-related  criteria  seem  good  predictors 
of  success •    "Responding"  and  "attending,"  as  defined  by  the  PALS  program  and 
as  measured  by  both  interviewers  and  observers  seem  to  discriminate  between 
successful  (high-rated)  and  unsuccessful  (low-rated)  subjects. 

3.  PALS  seems  to  be  effective  in  tracking  interpersonal  skills  to  its  trainees, 
PALS  trainees  out  perform  "controls"  not  only  in  PALS -related  variables  but  also 
on  dimensions  appearing  on  standard  interviewer  forms. 

As  mentioned  above,  however,  the  absence  of  a  control  group  in  the  strict  sense 
prohibits  us  from  saying  conclusively  that  PALS  produces  this  result.    We  can- 
not rule  out  the  possibility  that  high  "responders"  and  "attenders"  volunteer 
for  PALS  training.    Only  a  design  which  randomly  assigns  PALS  volunteers  to 
different  treatments  would  allow  a  strong  conclusion  about  PALS  effectiveness. 
However,  an  examination  of  several  background  characteristics  failed  to  disclose 
any  systematic  differences  between  PALS  and  "control"  groups 

4.  The  generally  favorable  tone  of  this  evaluation  must  be  tempered  by  the 
realisation  that  only  two  aspects  of  a  very  complex  program  have  been  addressed, 
"responding"  and  "attending."    Future  evaluations  should  attempt  to  deal  with 
other  aspects  of  this  program. 
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Questions  other  than  those  stated  as  objectives  were  raised  and 
attempts  were  made  to  addrr  s  them.     However,  insufficient  data 
and/or  lack  of  proper  instrumentation  made  the  results  of  this 
facet  of  the  research  highly  suspect  in  terms  of  statistically 
significant  results.     Hcwever,  the  issues  raised  by  attempting  to 
research  these  questions  lay  a  base  for  the  possibility  of  further 
research  implications. 
Question  One 

Is  there  a  relationship  between  teacher  communication  skills  le\-el 
and  student  achievement? 

Correlations  were  calculated  in  order  to  determine  if  a  relationship 

exists  between  the  human  interpersonal  skills  (measured  by  the  paper/ 

pencil  test)  and  the  student  performance.     A  portion  of  the  teacher 

selection  inventory  was  used  to  measure  these  human  skills. 

Teacher  Communication  Tost      N=  6 

mean  -  41.77  S.D.   -  3.77 

vs.  r=  -0.29 

Sfu^ent  Pnst  Test 

me-i;i       30.13  S.D.  -  3.04 

;cs  t  i  on  T  .0 

!j   there    t  re  1  it  ionsi.ip  bct'veen  teacher  educational  skill  level 
student  achievement? 

Iv.  te.ms        the  teacher  performance  on  the  educational  achievement 
test,   the  relationship  is  negative. 
Teacher  Education  Skill  Level    N=  6 

mean  -   154.0  S.D.  =  48.56 

vs.  r-  -0.30 

Student  Post  Test 

mean  -   30.13  S.C.  =  3.04 
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Question  Three 

Is  there  a  relationship  between  teacher  performance  of  career 
skills  and  student  performance  of  the  same  skills? 

In  order  to  establish  the  relationshop  between  teacher  knowledge 

of  the  curriculum  and  student  achievement  the  teachers  were  given 

the  identical  test. 

The  test  covered  the  three  major  curriculum  areas,  expanding, 
narrowing  and  preparing.     Correlations  were  run  between  this 
teacher  data  and  equivalent  student  data.     For  an  n=6,  df=4  a 
value  of  .81  is  required  for  significance  at  the   .05  level. 

CAREER  ACHIEVEMENT  SKILLS 


Expanding 


^tean 
S .  P . 


Narrowing       J  Preparing 


Teacher  ^Student  Teacher  j Student  I  Teacher 
14.33    ,  11.05       12.83     *    11.52  10.33 


.51    ■  1.40 
0.85 


4.83 


1.43 


3.93 


Studentjeacher 


7.15 
2.72 


0.24 


.74 


Tot-.l 


37.33 
7.76 


Student 
30. 13 
3.04 


0.43 


Examination  of  the  data  reveals  a  high  positive  correlation 
between  student  and  teacher  performance  in  expanding  (r=.85),  and 
in  preparing  skills   (r=.74)  while  a  low  negative  correlation  in 
narrowing  skills   (r=  -0.24).     However,  the  small  standard  deviations 
in  each  of  these  3  sets  of  data  indicate  that  the  variation  within 
teacher  scores  is  very  low.     Therefore,  correlations  derived  from 
this  data  can  easily  be  misleading  and  must  be  used  and  interpreted 
cautiously.     Therefore,  although  the  former  data  suggest  somj 
correlation,  the  data  derived  from  the  total  does  not  support  the 
assumption  that  student  performance  is  related  to  teacher  performance 
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question  Fcur 

Is  there  a  relationship  between  the  teacher  observation  score 
during  one  teacher  observation  and  total  stuaent  outcome. 

For  the  six  teachers  who  administered  the  post-test,  and  for  whom  we 
have  teacher  observation  data,  a  comparison  was  made  between  the 
level  of  teacher  performance  and  student  level .     Teachers  were 
analyzed  by  grouping  them  into  categories  high  and  low.     If  they  were 
in  the  upper  S0%  in  an  area,  they  were  considered  hxgh,  if  in  the 
lower  S0%  they  were  considered  low.     The  students  we -e  then  analyzed 
using  a  similar  criteria.     If  more  than  50%  achieved  an  acceptable 
score,  they  were  considered  high.     From  that  data,  a  2  x  2  matrix 
was  constructed  to  determine  if  a  relationship  exists. 

Teacher  Obcarvation  Scores 

Student  Perforasjice 


Teacher 

•7e  OLservution,  Upper  50?^     j        Obj actives »  Upper  30^ 
Scores  per  Area                |        Scores  per  Objective 

1 

Ob£?.?rvr.t^i3n 
1  ?-  1  5  i  > 

Arsi 
5 

i 

6  . 

X 



Ob 
2 

jcc 
3 

h 

e  N 

i> 

6 

or 

9 

■ji  II. ■  f 

1 

U 

i 

!  1 

1  X 

ix) 

X 

[M  LL 

2 

:c 

X 

r- 

r. 

X 

(x) 

X 

>: 

:< 

X 

5 

X 

'A 

X 

i 

X 

X 

6 

1  ^ 

5: 

X 

1  , 

X 

1 

\- 

X 

X 

(    )  -  Inply  tie  in  nuore  value 

jc     ••  An  X  pieced  in  catris  for  upper  ccores 
for  each  colmin. 


Six  observation  areas  were  considered.     Where  the  teacher  scored 
high,  an  X  was  placed  in  tl.at  cell.     Where  the  students  rated  high 
on  an  objective,  an  X  was  placed  in  that  cell.     The  total  number 
of  X's  for  the  teacher  and  student  was  determined  and  plotted  on 

;  below  2x2  matrix.     The  numbers  on  the  chart  are  the  teacher 
numbers  corresponding  to  the  above  chart. 
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Number  of  x^s  per 
teacher  for  Te 
Observation  Scores 


b 

l| 

II 

(^)  1 

(3>  (6) 

III 

"iv"^ 

(5) 

2 

(2)  , 

1 

CD  ' 

2      3      if      5  6 
Number  of  x's  per  teacher 
for  Ss  Objective  Scores 
(#)  -  Teacher  Number 


Quadrant  I 
II 
III 
IV 


High  Perfox^mins  Teacher,  Low  Performing  Students 
High  Performing  Teacher^  High  Performin.^  Students 
Low  Performing  Teacher »  Low  Performinsr  Students 
Low  Performing  Teacher,  High  Performing  Students 


Using  the  Davidof f-Goheen  estimate  of  the  tetrachloric  correlation  from  th<5 
a^'^bc  xulations  indicate  that  there  is  a  zero  (O..O)  correlation  between  student 
and  teacher  behavior,    A  PHI  coefficient  results  in  a  r  of  »33^    With  an  n=6, 
a  value  of  •75  is  required  to  show  significance  at  the  90?^  confident  ■  level*. 
Hov;ever,  the  fact  that  the  teacher  data  was  collected  during  only  one  observa- 
tion on  an  instrument  v/hose  reliability  has  not  been  completely  established 
makes  useful  interpretation  of  this  data  unlikely^    (See  Evaluation,  Section  9) 
Therefore,  it  can  be  said  that  the  data  does  not  support  the  hypothesis  that 
teacher  level,  as  determined  by  the  observation  instrument,  is  in  any  way 
related  to  student  outcome  or  performance* 
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Phase  II  -  Objective  Six 

In  Phase  II  of  the  CAST  project  Al  Pavlish  from  the  Pontiac  Besearch 
and  Development  Department  made  an  attempt  to  computerize  the  CAST  skills 
so  that  a  student  could  learn  them  using  a  computer  mode  as  well  as  from  a 
personal  mode. 

Because  the  curriciilum  was  still  in  the  early  developmental  stages t 
the  program  could  not  be  completed. 

However,  because  much  time  and  effort  was  devoted  to  developing  this 
computer  program,  a  description  of  the  program  smd  results  are  included 
in  this  Phase  III  Final  Heport. 
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Phase  II  Ob,iectlve  SiK 
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Computerized  Curriculum 

In  keepinc  with  the  goals  of  the  projject,  a  study  was  made  during  Phase  II 
to  determine  if,  at  that  time,  it  was  advisable  to  undertake  a  concerted  effort 
in  computerizinc  all  or  part  of  the  CAST  program.  It  is  being  reported  at  this 
time  because  the  research  v;as  incomplete  at  the  end  of  Phase  II. 

Firr.t»  an  assessment  was  made  to  determine  if  the  CAST  curriculum  de- 
Vi.'lopeu  wap  advanced  to  the  level  where  the  components  of  the  various  skills 
were  delineated  and  sequenced  to  a  level  of  certainty  hi^h  enough  to  justify 
the  prof:ramr.inc  effort.    Secondly,  an  evaluation  was  made  to  determine  which  of 
cwo  available  languages  would  be  better  suited  for  the  computer  assisted 
instruction  (CAI)  procramir.in":  task.    Thirdly,  two  high  school  students  ;-/ere 
•Uroc.  and  trai-'.e.i  to  bccin  tc^  pronram  v;here  possible  the  "ilxpandinc  and 
::a"rowini:"  oklllr,.  rii'st  tv;o  chapters  in  the  CAST  prorram).    In  their 

l^rorrai.ininc  autemptst  the  students  used  the  following  resources; 

a.    A  local  .?7^-i  torainal  which  was  remotely  connected  to  a 

360/50  cor.,putor  at  the  Oakland  Intermediate  School  District 
Office. 

u.    Tlie  langua^'  -  ITF  (an  IBM  version  of  BASIC)  and  Coursewriter 

which  were-  available  on  the  local  27^1  terminal, 
c,    CAST  Curriculum 

From  past  experience,  it  seemed  desirable  not  to  use  the  slow  typewriter 
terminal  ClBI-:  27^1)  but  rather  a  CRT  (cathode  ray  tu^.-)  which  is  currently 
available  fro.71  IBM.    It  can  display  at  a  much  higher  rate  and  also  superimpose 
images.    Unfortunately,  in  order  to  have  this  equipment  available,  an  exten- 
sive and  expensive  hardware  modification  would  be  required.    Therefore,  the 
much  less  desirable  hardward  had  to  be  used. 

Tne  IBM  remote  system  has  two  languages  available  -  ITF  and  Coursewriter. 
In  order  to  properly  assess  which  would  serve  the  requirement  best,  the  CAST 
curricuiun:  was  progra;nr,ed  in  both  by  students  trained  in  both  languages. 
(Both  languages  have  their  advantages  and  disadvantages,  neither  of  which 
really  scrveJ  'cho  programming  function  well.) 

Using  thf  existing  curricu3.um,  parts  of  the  first  two  chapters  of  •»Expand- 
Narriowing"  v.'ore  programmed.    Several  groups  of  people  -  students, 
teacher.-,  etc.,  investigated  the  programmed  materials.    The  general  conclu- 
sion reached  by  them  was  that  the  computer  could  probably  deliver  what  was 
p^^-j,.^p^^^,l  effectively;  however,  due  to  the  developmental  nature  of  the  curricu- 
^nr,  it  var.  determined  the  computer  delivery  should  cease  until  the  curriculum 
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and  human  delivory  system  is  more  complete  in  its  design  and  development. 

At  this  time  it  is  recommended  that  no  further  attempt  he  made  to 
computeri?-.e  the  first  two  chapters  in  the  Career  Achievement  Skills  Training 
program  until  a  well  defined  human  system  if  operable. 

The  following  may  be  found  in  the  referred  areasj 

a  sample  Computer  Output  (Appendix  P) 
copies  of  the  Coursewriter  (Appendix  Q) 
BASIC  Programs  (Appendix  S)  and 
a  Terminal  Usage  Program  (Appendix  S) 
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Outconses  and  Sec ommendat ions 


Students  Selected 

Students  should  have  been  randomly  selected  for  the  experimental  classes 
rather  than  being  selected  oecause  they  were  convenient •    This  would  have 
insured  an  even  distribution  of  the  population  between  the  experimental  classes. 

Control  groups  could  have  been  used  had  there  been  a  comparable  group 
who  was  receiving  a  career  education  program  that  was  addressing  the  same 
objectives  as  CAST. 

Students  in  Phase  II  shotJ^d  have  been  followed  up  in  Phase  III  and 
possible  should  have  received  CAST  instruction  a  seconu  year* 
Hore  students  representing  all  grade  levels  should  have  been  included 
in  the  project.    Tlxis  would  have  meant  increasing  the  teacher  (n)  which  is 
higiily  recommended  for  statistical  purposes.    Having  more  teachers  and  a 
wider  ranc^  of  students  would  have  provided  more  infonnation  to  use  in 
comparing  the  growth  of  students  on  the  CAST  skills  from  grade  level  to 
grade  level. 

Instrunients 

The  modular  tests  were  good  for  review  purposes  but  were  very  time 
consuming.    It  is  recommended  thixt  the  tests  be  used  simply  for  review 
(to  take  home)  and  the  students  given  the  answer  sheets  to  check  their 
own  responses. 

The  Gunmary  question  was  an  attempt  to  have  the  students  apply  wha^ 
^h^y  learned  in  developing  a  career  plan.    Because  it  was  a  free  response 
iteint  the  scoring  was  somewhat  difficult.    It  is  recommended  that  a  testing 
procedure  be  developed  which  evaluates  student  learning  as  it  relates  to  a 
practical  application  of  the  skills  being  taught.    This  might  involve  an 
interview,  observation  and/or  paper  and  pencil  measurement.    Using  a  paper 
and  pencil  test  alone  does  not  measure  adequately  all  the  skills  the  students 
have  learned. 

Discussion  of  Data 

Elementary  students  can  learn  career  achievement  skills  if  they  are 
simplified  and  presented  in  the  context  of  their  world.    They  do  need  daily 
reinforcomont  and  a  gr^ at  deal  of  practice  so  that  the  skills  become 
internalized.    For  example,  decision-making  skills  could  be  taught  to  the 
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early  elementary  students  if  the  process  were  simplified,  applied  and  re- 
inforced in  their  day  to  day  classroom  decisions. 

Junior  Hi/th 

CAST  students  outperformed  non  CAST  students  in  developing  a  career 
plan.    The  areas  where  the  teachers  did  not  spend  as  cjuch  time  or  were  not 
as  confident  in  their  understanding  of  the  material,  the  students  did  not 
score  as  higlily.    Tliis  has  implications  for  improving  the  CAST  Inservice 
Training. 

Teacher  Selection  Inventories 

The  teacher  selection  inventories  are  ^  good  initial  assessment  of 
teacher  effectiveness,  but  should  be  used  along  with  an  interview  or  ob- 
servation of  teacher  performance  to  insure  the  most  accurate  selection. 
Aj.no,  the  scoring  criteria  on  the  educational  assessment  instrument  needs 
to  bo  spoiled  out  more  specifically. 

Observational  Checklict 

The  observational  criecklist  was  appropriate  for  teacher  diagnosis 
and  feedback,  but  needs  refinement  so  that  it  will  yield  more  reliable 
data  and  can  be  used  for  evaluation  purposes.    Once  the  slcills  are  defined 
more  npocif ically ,  then  impartial  observers  need  to  be  trained  more  syste- 
matically on  how  to  use  it.    Also,  repeated  measures  need  to  be  made  during 
the  year  and  related  to  the  objective  being  delivered.    Also,  a  control 
proup  of  teachers  needs  to  be  included  so  that  a  comparison  can  be  made 
between  those  who  have  been  trained  and  those  who  have  not. 

From  both  the  paper  and  pencil  inventories  and  the  classroom  observa- 
tions, it  can  be  concludc-d  that  CAST  teachers  did  acquire  the  skills  they 
worf>  tau~ht. 
Cupttctlve  Four 

CAST  tvainors  adequately  delivered  the  human, education  and  career 
skills  in  all  but  two  areas  -  program  development  and  learning  strategies. 

CAST  trainers  reported  additional  skill  growth  between  the  end  of  the 
summer  training  and  the  end  of  the  project. 
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Therefore,  it  can  be  concluded  that  the  trainers  zonXd  train  best 
th07e  skills  that  they  could  perform  best. 

Curriculujn 

CAST  participants  felt  that  the  Phase  II  Lesson  Plan  Manual  was  best 
used  as  a  training  tool  with  the  teachers  and  counselors  developing  their 
own  delivery  lessons.    Teachers  and  counselors  did  feel  that  a  Phase  III 
Lesson  Plan  Manual  would  be  helpful  if  it  were  to  provide  addi^  ional  training 
stratecies  and  methods. 

It  is  recon^mended  that  the  curriculum  be  monitored  more  closely  in 
terms  of  assessing  what  methods  and  strategies  deliver  which  objective 
best  in  what  tinie  period. 

PAU> 

Students  using  the  CAST  skills  at  the  high  school  level  have  a  90^  greater 
chance  of  beinr;  hired  than  students  not  using  the  skills. 

All  of  these  conclusions  substantiate  the  fact  that  the  CAST  program 
did  deliver  skills  to  students,  teachers-counselors  and  trainers  which 
have  made  a  difference  in  their  effectiveness. 
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MAJOR  FINDINGS 


This  section  includes  the  following: 

1.  Sunimary  of  the  major  findings  of  Phase  III 

2.  Application  of  these  findings  for  other 
projects 

5,    Implications  of  these  findings  for  further 
research 
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SuBBjary 


The  following  are  major  conclusions  drawn  from  the  CABS  program. 


Students 


Elementary  students  can  learn  the  career  achievement  skills. 

CAST  junior  high  students  sisnifxcantly  outperformed  non  CAST  students 
in  developing  a  career  plan. 

Hirh  school  students  trained  in  the  CAST  skills  and  human  skills  stand 
a  90^fe  greater  chance  of  being  hired  for  a  job  than  non  CAST  students. 

Training 

Teachers  and  counselors  trained  by  CAST  trainers  did  show  significant 
Cains  in  the  hunan  and  educational  skills  from  pre  test  to  post  test. 

Classroom  observations^  individual  teacher  programs  and  evening 
followup  sessions  did  increase  teacher  level  of  functioning  over  the 
course  of  the  year. 

All  teachers  felt  that  the  inservice  training  was  necessary  to  deliver 

all  or  part  of  CAST. 

Curriculum  Devclppnipntand  Delivery 

Over  7^%  of  the  teachers  felt  that  the  curriculum  was  better  than 
the  traditional  materials  in  terms  of  student  learning. 

Approy-imately  77Ju  of  the  teachers  felt  that  the  best  way  to  deliver 
CAST  was  using  the  lesson  plan  manual  and  the  comic  book  -  Kxe  Story  of 
Who  (Carkhuff  197^)  together. 

Ninety-nine  percent  of  all  teachers  felt  thst  CAST  could  be  integrated 
into  the  existing  curriculum. 

CAPS 

Students  using  CADS  can  complete  the  instrument  in  one-fourth  the 
tir.je  that  students  using  the  non  computerized  version  of  Dr.  John  Holland's 
"Self-Directed  Search". 
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Applications 


The  following  statements  are  suggested  applications  of  the  CAST 
progran* 

Students 

If  students  are  taught  to  transfer  the  CAST  skills  into  other  areas 
of  their  lives^then  they  will  see  the  universal  application  of  the  skills 
so  that  they  can  use  the  skills  in  all  the  aspects  of  their  lives  -  Living, 
Le2^ ruins  Working. 

If  CAST  students  are  trained  as  interns  to  teach  other  students  the 
CAST  clcillS|then  the  CAST  students  will  be  held  responsible  for  anothers' 
learning  and,  therefore ,  inr;ure  that  they  have  mastered  the  skills* 

Training 

If  parents  are  trained  in  the  CAST  skills^ then  they  will  understand 
what  skills  their  children  arc  learning  so  that  they  can  help  then  learn 
and  apply  the  skills. 

If  eaiployers  az^e  trained  in  the  CAST  skills,  then  they  will  understand 
the  preparation  their  interns  have  had  and  will  be  better  able  to  plan  a 
Kieaningful  internship  experience* 

If  retired  people  can  be  trained  to  assist  in  the  CAST  program, then 
they  will  be  able  to  sliare  their  experinces  and  skills  with  the  CAST 
students  so  that  the  students  will  have  older  adtilt  nodels  to  which  they 
can  relate* 

If  the  inservice  training  model  is  adopted  by  the  school  district,  then 
it  can  serve  as  the  staff  development  delivery  system  model,  so  that  benefits 
from  all  special  programs  can  be  disseminated  to  all  school  district  staff. 

Internships 

If  the  internship  program  can  be  coordinated  with  existing  vocational 
programs,  then  stuuents  will  be  better  able  to  choose  systematically  their 
vocational  placement  so  that  it  leads  towards  their  larger  career  goal* 

If  internships  can  be  leveled  according  to  length  and  depth  and  sequenced 
to  provide  increasing  degrees  of  independence, then  students  will  move  through 
a  series  of  experiences  which  meet  their  individual  needs  so  that  they  can  be 
successful  each  step  of  the  way» 
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If  a  transportation  system  can  be  developed  and  supported  in  conjunction 
with  local  business  and  industry,  then  the  community  would  have  an  investment 
in  the  program  so  that  the  students  would  be  provided  with  the  greatest  number 
of  experiences  possible. 

Curriculum  Development  an'i  Delivery 

ir  a  K-12  curriculum  is  implerr.entod  from  the  e:-:isting  lesson  plan  manuals 
and  <-i/i.iic  books  then  students  would  progress  through  a  series  of  planned  career 
stens  which  would  insure  their  acquiring  the  skills  at  increasing  levels  of 
sophist icat ion. 

If  the  CAST  curriculum  is  integrated  with  the  existing  curriculum,  then 
the  students  will  see  the  relationship  between  the  career  skills  and  their 
content  skills  go  that  they  will  begin  to  transfer  the  CAST  skills  into  all 
areas  of  their  learning. 

CAPS 

If  CADS  is  further  developed  by  counselors  and  integrated  with  existing 
career  sources  ana  value  exploration  exercises,  then  it  will  be  more  meaning- 
ful for  the  students  go  that  they  can  use  it  to  generate  as  much  information 
about  themselves  as  possible. 
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Implications 


The  followirv;  statements  are  implications  for  further  research. 
Students 

The  affective  sureas  of  student  learning  related  to  career  decision- 
making and  self-exploration  need  to  be  further  defined. 

Teachers 

The  effects  of  different  teacher  delivery  systems  on  student  learning 
needs  to  be  addressed. 

Tlie  breadth  and  depth  of  training  necessary  for  a  successful  CASTT 
pro^rain  needs  to  be  detemined. 

Internships 

The  lenf^th,  breadth,,  nature,  and  value  of  the  internship  to  students* 
self  and  career  exploration  needs  to  be  further  defined. 

Parents 

The  ir^fluence  of  parents  on  the  students*  decision-making  process  needs 
to  be  addressed. 
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May  29,  1974 


Ms.  Judy  Battenschlag 
Director 

Career  Achievement  Skills  Program 
Pontiac  School  District 
1830  West  Square  Lake  Road 
Pontiac,  Michigan  4&053 

Dear  Ms.  Battenschlag: 

Permission  is  hereby  granted  you  to  adapt  and  to  program  for 
computer  scoring  the  Sslf -Directed  Search  and  related  materials 
by  John  L.  Kclland  in  a  research  program  known  as  the  Career 
Achievement  Skills  Training  with  the  tmderstaniing  ti  at  the 
attached  stat<*inent  or  a  substantial  equivalent  will  accompany 
any  printed  materials  utilizing  the  SDS  or  the  Occupations 
Finder. 

It  is  further  undcrst-nod  that  any  adapted  materials  will  not 
be  sold  without  further  written  authorization  iroa  us. 
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JUNIOR  NIGH  FINAL  VERSION 


Student  Nor« 
School  _ 


Date 


To&chcr  _ 
CIa66  Hour 


CA© 


KST  copy  jiy/ii^g^ 


ootiPirro  assxsisd  occopaiiou  sosba 

Career  Ach^' ovor.ont  SkiTlr.  Procran 

Developed  cooperatively  by  Judy  Battonschlac,  Director  of  CAST 
o  .  A^^  j^lishf  Assistant  Director  of  Pbntiac  Research  and 

ERJC  Odu  Development  Department 

^-—^  PontiaCf  Kic:.ii;an 


Ihe  following  loaterlal  is  esaentiaUy  derived  ixom  the 
works  of  Dr.  John  BoUaad*   The  najority  of  the  material  oomes 

Dr.  Holland*n  Self  Direoted  Search  (SDS)  iastruseat. 

The  SDS  is  copyil^ted  by  Consulting  Poyo^olegist's  Presst 
S7f  CoUege  Ave.«  Palo  Alto,  dOifomia  9'»3Q6. 

This  material  is  being  tested  as  part  of  the  Career  Achieve* 
ment  Skills  Training  (CAST)«  a  revised  Besearoh  and  DevelopaeM 
Project  in  Vocational  Education  conducted  under  Part  C  of 
Public  law  90576;  a  supplementary  alloeation  to  the  Michigan 
Department  of  Sidueation«  under  OS  Letter  of  Assurance 
#0*^610<»1-I*t  sttbcontraeted  under  Grant  Award  OED-0-72'-07'»9* 

The  purpose  of  modifying  Dr.  BoUa9d*s  SDS  instrument  was 
to  invoaticate  the  following  questions t 

1.  Can  the  instrument  be  sinpUfled  to  be  use- 
Ail  for  junior  high  and  elementaxy  school 
students? 

2.  Can  the  instrument  be  modified  to  facilitate 
computer  scoring  of  student  responses? 

3.  Can  the  instrument  be  modified  to  be  consis- 
tent with  the  processes  and  objectives  of  the 
CAST  prograna? 

This  modification  of  Dr.  Holland's  instrument  is  solely  Intended 
for  limi  ted  use  as  part  of  the  research  and  dev^opment  of  the  CAST 
program.   Anyone  wishing  to  use  this  materiel  in  any  way  must  receive 
written  permission  fromt 

Dr.  John  Black  or 
Dr.  John  Holland 
577  College  Avenue 
Palo  AltOf  California 
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Uarken  the  circle  (t)  under  ••L"  (for  LI!C)  for  those  activities  you  have  enjoyed  doing 
or  would  like  to  do.   Total  the  number  of  circles  you  have  darlcened. 


X.  SBtfJSTIC 

O  fix  electrical  things 

0  fiepalr  ceurs 

0  Hx  mechanical  things 

0  Build  things  with  wood 

O  Drive  a  truck  or  tractor 

O  Use  metalworking  or  machine  tools 

0  Work  on  a  hot«  rod  motorcycle  or 

bicycle 
O  Build  models 

O  Cut  out  and  sew  a  garment  from  a 
pattern 

0  Take  courses  in  cooking  and  sewing 
0  Plant  and  care  for  a  flower  or 
vegetable  garden 

O  TOTAL  NO.  OF  L»s 

L  XKVESTIGATIVE 

O  Road  science  books  or  magazines 

0  W6rk  in  a  science  laboratory 

0  Work  on  a  science  project 

0  Build  rocket  models 

0  Work  with  a  chemistry  set 

0  Solve  math  puzzles 

O  Play  chess 

0  Work  with  cheaieals 

0  Take  hi^er  math  courses 

0  Study  planes  and  aninala 

0  Bead  about  special  subjects  on 
my  own 

OTOTiO.  NO.  OF  L*s 

t  ABIZSTIC 

0  Sketch*  draw  or  paint 

0  Attend  plays 

0  Design  furniture  or  buildings 

0  Play  in  a  band,  group  or 

orchestra 

0  Practice  a  musical  instrument 

0  Go  to  concerts  or  musicals 

O  Bead  popular  fiction  books 

0  Draw  portraits 

0  Bead  plays 

0  Bead  or  write  poetry 

0  T)ike  Art  courses 

O  'BOfSXL  NO.  OF  L*8 


0  Vrlte  letters  to  friends 
0  Attend  servioes  at  a  church  or  temple 
(ex*  -  scouts,  church  youth  groups, 

youth  divisions  of  political  parties, 

recreation  leagues) 
0  B^p  others  with  their  personal  problems 
0  Tnke  care  of  children 
0  Go  to  parties 
0  Dance 

0  Bead  books  about  people  and  the  way 

they  act 
O  Flay  team  sports 
0  Qo  to  sports  events 
0  Make  new  friends 

O  TOTAL  NO.  OF  L»s 

L  EMTERPRISINa 

0  Convince  others  to  do  ^^t  you  want 

0  Sell  something 

0  Discuss  current  events 

0  Operate      own  service  or  business 

0  Attend  a  weekend  meeting 

0  Olve  talks 

0  Serve  as  an  officer  of  any  group 

0  Show  others  how  to  do  or  make  something 

0  Meet  important  people 

0  Bo  a  group  leader 

0  Help  a  friend  running  in  a  school  election 
O  TOTAL  NO.  OF  L«8 

L  CONVENTIONAL 

0  Keep  your  desk  and  room  neat 

0  Type  papers  or  letters  for  yourself 

or  for  others 

0  Add,  subtract,  multiply  and  divide 

numbers  in  business 

0  Operate  office  machines  of  any  kind 

0  Keep  detailed  records  of  expenses 

0  Take  a  T^ing  course 

0  Work  in  the  office 

0  Take  a  Business  Math  course 

0  Assist  the  teacher  with  correcting  papers 

0  Put  letters,  reports,  records  in  order 

0  Write  business  letters 

O  TOTAL  HO.  OF  L«s 
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OQNPECENCIES 


Darken  the  circle  (•)  under  (for  Yes)  for  those  sotivities  you  can  do  wOll. 
Totio.  the  nuDber  of  olrelea  you  have  darkened* 

Y  £X>CIAL 


T  RBALZSIXC 

0  Z  have  used  wood  shop  power  tools 

.such  as  a  power  saw  and  lathe 
0  Z  can  adjust  engine  parts 
0  Z  have  operated  netal  shop  power 
tools  such  as  a  drill  press  or 
grinder 

0  Z  can  refinish  furniture  or  woodwork 
0  Z  can  eook  a  neal  using  recipes 
0  Z  can  cut  out  a  dress  using  a  pattern 
0  Z  can  grow  flowers  and/or  vegetables 
0  Z  can  plan  and  shop  for  a  week's  seals 
0  Z  can  make  sinple  electrical  repairs 
0  Z  can  repair  children's  toys 

O  NO.  OF  Y's 

Y  WBSTIQASIVE 

0  Z  can  naioe  throe  foods  that  are  hi^ 
In  protein  content 

0  Z  understand  how  electromagnet  works 

O  Z  understand  photosynthesis 

0  Z  can  use  nultiplication  tables 

O  Z  can  use  a  ruler  to  measure 

O  Z  can  locate  a  street  using  a  map 

0  Z  can  identify  some  constellations 
of  the  stars 

0  Z  can  describe  the  job  of  the  %Aiite 
blood  cells 

0  Z  understand  the  use  of  cross  refer- 
ences in  a  dictionary  or  encyclopedia 

O  Z  use  the  telephone  directory  to  locate 
people  and  services 

O.TOTAL  NO.  OF  Y's 

T  ABTISTIC 

0  Z  can  play  a  musical  instrument 

0  Z  can  sing  in  a  choir 

0  Z  can  perform  as  a  musical  soloist 

0  Z  can  act  in  a  play 

0  Z  can  do  a  painting  or  sculpture 

0  Z  can  do  modem  or  ballet  dancing 

0  Z  can  sketch  people  .so  that  they  can 

be  x'ecognized 
0  Z  can  make  pottery 
0  Z  can  design  clothing*  postersi  or 

furniture 
0  Z  write  stories  or  poetry  well 

O  WEAL  NO.  OF  Y»s 
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0  Z  SB  good  at  explaining  things  to  others 
0  '  Z  have  helped  earn  money  for  charity  or 

a  walkathon 
0   I  cooperate  and  %fork  well  with  others 
0  I  can  be  a  good  host  (hostess) 
0  1  Can  teach  children  easily 
0  Z  can  plan  entertainment  for  a  party 
0   Z  an  good  at  helping  people  who  are 

upset  or  troubled 
0  I  have  worked  as  a  volunteer  aide  in  a 

hospital «  clinic «  or  home 
0  1  affl  a  good  judge  of  r*^plo 
0  Z  can  jklan  school  or  church  social 

6if  fairs 

O  TOTAL  NO.  OP  Y's 

Y  HITBBPSISINQ 

0   I  have  been  elected  to  an  office  in 
school 

0   1  can  h^p  others  do  or  make  something 
0   Z  an  good  at  getting  people  to  do  things 
my  way 

0  Z  know  how  to  set  a  goal  and  plan  a 
course  of  action  to  reach  it 

0   I  loaow  how  to  get  help  when  Z  can't  do 
a  job  by  myself 

0  X  Uftve  acted  as  a  spokesman  for  some 
^rottp  in  presenting  suggestions  or 
complaints  to  a  person  in  authority 

0   Z  won  an  award  for  work  as  a  salesman 
or  leader 

0  1  have  started  a  club,  group*  or  gang 
0  Z  can  figure  out  different  ways  of 

getting  a  job  done 
0  I  know  how  to  be  a  successful  leader 

O  TOTAL  NO.  OF  Y*s 

Y  OOWQITIOHAL 

0  1  can  organize  the  tools  and  materials 

in  a  school  or  hone  shop 
0  X  can  predict  and  plan  most  of  ny 

incone  and  expenses  for  the  next  iK>nth 
0  X  can  alphabetise  and  fthelve  books  in 

a  library 

0  I  can  put  letters  or  reports  in  order 

0   X  have  held  an  office  job 

0   X  can  organize  my  room 

0  X  can  do  a  lot  of  paper  work  in  a 

short  tine 
0   X  can  use  an  addinf^  mgichlne 

0    41  can  k'sr^  r'jcox'da  ox'  r.y  exi'o^iuce 
O  SOTAL  HO.  OF  Y»a 


OCCUPATIONS 

Xlilo  ±8  an  Inventory  of  your  leelings 
Show  the  occupations  that  Interest  or 
under  the  **V*  for  Yes. 

t  KBAUSTIC 

0  Aii^ane  Mechanic 

0  Flah  ar  d  VUdlife  Spoeialiat 

gOreen  House  Operator 
Medical  tab  Technician 

0  Construction  Inspector 

0  Radio  Operator 

0  Filling  Station  Attendant 

0  Tbol  Designer 

0  Sewing  Instructor 

0  Eleotrioian 

O^ALNO.  OFT«s 

T  mVESTIQATIVS 

0  Biologist  -  Studies  the  human  body 
0  Census  Taker 

0  Anthropologist  -  Studies  earth's 

history  of  men 
0  Zoologist  -  Works  with  animals 
0  Chemist  -  Works  with  chemicals 
0  Market  researcher  -  Studies  people's 

opinions 
0  Writer  of  Scientific  Articles 
0  Investigator  of  fire  or  auto 

insurance  claims 
0  Geologist  -  Works  with  rocks  and 

minerals 
0  Botanist  -  Works  with  plants 

Q  TOTAL  NO.  OF  Y*s 

T  ARTISTIC 

O  Poet 

0  Musician 

0  Author  of  Books 

0  Conneroial  Artist 

0  Newspaper  Art«  Music  or  Drama  Critic 

O  Art  Gallery  Owner 

0  Singer 

0  Courser 

0  Writer  of  Plays 

0  Theatre  Stage  Manager 

O  TOTAL  NO.  OP  Y»s 


and  attitudes  about  many  kinds  of  work* 
appeal  to  you  by  darkening  the  circle  (•) 

'  T  SOCIAL 

0  Religiotta  Worker 

0  Bigli  S^eol  Tttaeher 

0  Nurse 

0  Speech  Therapist 

O  Physieal*  ifdueation  Teacher 

0  Playground  Director 

0  Psychologist 

0  Social  Science  Teacher 

0  Asst*  City  School  Superintendent 

0  Counselor 

O^XJTALNO.  OF  Y«s 

T  BOERPBISINa 

O  Advertising  Agent 

0  Store  Owner 

0  Television  Producer 

0  Hotel  Manager 

0  Business  fixecutive 

0  Restaurant  Worker 

0  Master  of  Ceremonies 

0  Sslesman 

0  Announcer 

0  Political  Canqpaign  Manager 

O  TOTAL  NO.  OF  T*s 

T  OONVSITIDNAL 

O  ULbrarian 

0  Treasurer 

O  Traffic  Manager 

0  Mathematician 

0  Court  Secretary 

0  Bank  Teller 

0  Tax  acpert 

0  Cofltputer  Operator 

0  Payroll  Clerk 

0  Bank  President 

O  TOTAL  NO.  OF  T*8 
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Owktii  the  eirole  next  to  the  oeeupational  area  ih  *ajlch  you  are  nost  Interested. 

Science 
Outdoor 
Recreation 
(^Education 

Business  (Detail) 
Technology 
Business  (Contact) 
Service 

Darken  the  circle  next  to  the  highest  educational  level  you  plan  to  attend. 

Less  than  Ki^  School 
Hig^  School  Diploma 

OHig^  School  plus  sone  training 
(Junior  Qollege,  Trade  School) 

College  Degree  (four  years) 

More  than  four  years  of  College 
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SiXF-SSTXMATES 

Rate  yourself  on  each  of  the  following  traits  as  you  see  yourself  when  compared 
witli  other  persona  your  own  age.   Give  the  most  accurate  estimate  of  howj^ 
see  yourself^   Circle  the  appropriate  nuabbr  and  try  not  to  rate  yourself  the 
same  in  each  ability* 


MSCBANICAL  SCXEMTIFIC  ASTISTIC  TEACHXNa  SALES  CLERICAL 
ABILITY  ABILITY  ABILITY         ABILITY         ABILITY  ABILrTY 


BIOH 
AVERAGE 


5 
k 

3 
2 
1 
0 


5 
k 

3 
2 

1 

0 


5 
k 

5 
2 
1 
0 


5 
k 

3 
2 
1 
0 


5 
k 

3 
2 
1 
0 


5 

3 
2 
1 
0 


HIOH 


AVERAOE 


LOW 


HANUAL 
ABILITY 


MATH 
ABILITY 


MUSICAL 
ABILITY 


LINESS 


MANAGERIAL  OmCE 
ABILITY  ABILITY 
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APPENDIX  E 

CONTRACT  BETWEEN  EDUCATIONAL  SERVICES  AND  PRODUCTS  INC.,  AND  TOS  SCHOOL 
DSSIKICT  OF  THE  CITY  OF  PONTIAC,  NICBiaAN. 

!•    PARTIES  TO  THE  CONTRACT 

This  contract  sets  forth  the  relationship  between  The  School  District  of 
the  City  of  Pontiac,  Michigan,  and  Educational  Services  and  Products  Inc., 
.  Kalamazoo,  Michigan,  for  the  period  beginning  July  1,  1973  through 
June  30,  197^,  for  certain  third-party  evaluation  services  to  a  project 
entitled  "Human  and  Computer  Assisted  Guidance  Program",  formerly  entitled 
**CCQ(  Computer  Assisted  Quidance  Program",  conducted  under  Part  C  of 
Public  Law  90-576  and  funded  through  the  Michigan  Department  of  Education 
under  OE  Letter  of  Assurance  (project)  No,  V-26l0^1-L,  Grant  Award  OBO- 
O-72-07'*9,  the  plan  being  dated  August  1972  (revised  February  1973)- 

2.  STAFF 

Dr.  Theodore  L.  Ploughman  will  be  the  Educational  Services  and  Products  Inc., 
staff  member  primarily  responsible  for  the  conduct  of  the  terms  of  this  contract. 

3.  SCOPE  OF  SERVICES 

A.    TSxe  focus  of  Dr.  Ploughman's  evaluation  is  based  on  a)  the  general 

objectives  for  Phases  II  and  III  of  this  project  as  found  in  pages  5-13 
in  Appendix  A  "Plan  for  Phases  II  and  III"  (hereto  attached  as  Appendix  I 
and  made  part  of  this  agreement)  and  on  b)  the  detailed  objectives 
for  implementation  of  this  plan  as  described  on  page  four  in  the  "Plan 
for  Phase  III"  (hereto  attached  as  Appendix  II  and  made  a  part  of 
this  agreement). 

Dr.  Ploughman's  evaluation  function  will  include  auditing  and  verifying 
all  data  collection  assumed  by  the  Pontiac  Research  and  Development 
Department  as  veil  as  Carkhuff  Associates,  Inc.    In  addition  he  will 

rcrct  nr.'!  nr.  or..-?n".'<tions  bared  on  the  project  results. 
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Tb»  services  an^/or  materials  vhlch  Or.  Floughjsan  agrees  to  provide 
are  as  follows t 

1.  Reviews  student  skill  objectives  by  grade  level. 

2.  Reviews  and  critiques  evaluation  design. 

3*  Recommends  evaluation  design  changes,  if  necessary. 

Reviews,  critiques  and  assists  in  developing  all  evaluation 

instruments  and  data  analysis  procedures. 
3m  Monitor  all  evaluation  activities. 

6.  Submits  written  reports  containing  reviews,  critiques  and 
recommendations.    Reports  will  be  due  on  October  10,  1973t 
January  10  and  June  10,  197^. 
B.  Ibe  CAST  Program  Director  and  Fontiac  Research  and  Developa»nt  Department 
will  cooperate  with  Dr.  Ploughman  in  the  following  ways: 

1.  A  mutually  acceptable  evaluation  design  will  be  initiated  by  the 
Pontiac  Research  and  Development  Department. 

2.  Recommendations  for  and  development  of  all  evaluation  instruments 
will  be  cooperatively  undertaken  by  the  Fontiac  Research  and 
Development  Department  and  Dr.  Ploughman. 

3.  All  data  collected  by  Carkhuff  Associates  and  the  Pontiac  Research 
and  Development  Department  wiU  be  made  available  to  Dr.  Ploughman. 

4.  All  d&ta  collected  will  be  analyzed  by  the  Pontiac  Research  and 
Development  Department. 

5.  Vritten  status  reports  of  local  program  evaluation  efforts  will  be 
due  to  Dr.  Ploughman  by  the  tenth  of  each  month. 

1^.  GOMFiafSATION 

Dr.  Plou^iman  will  be  paid  $100  for  each  of  12  on-site  visits  and  $100 
for  each  of  12  program  planning  and  materials  development  days.  Included 
in  these  fees  are  all  administrative  and  materials  costs. 
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5«  HETHDD  OF  PAYMENT 

Payment  will  be  made  in  three  installments  in  October,  January  and  June 
for  services  actually  perfomed  and/or  products  delivered*    She  final 
installment  will  be  no  less  than  109$  of  the  total  amount  and  %rill  be  paid 
upon  receipt  and  approval  of  the  final  report*   C&e  total  amount  of  this  . 
contract  shall  not  exceed  Twenty- four  Hundred  dollars.  (82tiOO) 

6*  KEBTINQS 

Sepresentatives  from  Pontiac  Research  and  Development  Department  and 
the  CAST  Project  Driector  win  meet  with  Dr.  Ploughman  on  the  first 
Konday  of  each  month  or  on  an  alternate  day  aifreed  upon  by  both  parties* 
These  meetings  will  begin  September  1973* 

7.  CANCELLATION 

This  contract  may  be  cancelled  by  either  party  with  JO  days  written  notice. 

8*  EQUAL  OFFOSTUNXTr  CLAUSE 

Dr.  Ploughman t  in  the  performance  of  this  contract,  will  comply  with 
the  Equal  Opportunity  Clause  -  HEW  386  (Section  202,  Executive  Order 
112^,  September  2^,  1965.  30  FR  11269)  as  revised  Hay  1966.  As 
certification  to  that  effect,  a  copy  of  that  clause,  signed  by  Dr. 
Ploug^iman  is  attached  as  Appendix  III  and  made  a  part  of  this  agree- 
ment. 

9*  ADMJNXSTSATIVE  CONTROL 

It  is  agreed,  that  the  School  District  of  the  City  of  Pontiac  shall 
retain  administrative  control  over  the  provision  of  services  and/or 
materials  under  this  agreement. 
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10.    EVALUATION  RESORTS 

All  reports  of  evaluation  aetlYities  and  findings  will  bo  proaented 
Jointlor  to  the  Project  Director  and  the  Community  Action  Prograoi 
Office.   The  evaluation  reports  will  be  written  in  compliance  with 
the  following  reference: 

Preparinfg  Evaluation  Reports;  A  Guide  for  Authors,  68  pp.,  1970* 
All  information  and  findings  vrill  be  held  in  confidence  bgr  Dr.  Ploughman* 
Anj  publicity,  journal  articles  or  other  printed  matter  of  a  dissemin- 
ation nature  will  be  presented  to  the  Director  of  Community  Action 
Programs,  or  his  designated  representative  for  concurrence  and 
approval  prior  to  publication  or  research*  * 

•  • 

n*  OONCORRENCE 

Ihis  agreement  becomes  in  force  upon  signature  of  both  parties  and 


approval  of  the  U*S*  Office  of  Education* 


waonnom,  services  and  products  inc. 


TBB  SCHOOL  DISTRICT 
OF  THE  CITf  OF  PONTIAC 


Director  of  Pupil  Personnel 
Services 


Evaluation  Consultant 
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Appendix  III 


EQUAL  EMPLOYMENT  OPPORTUNITY 
(Section  202,  Executive  Order  1X246,  September  24,  1965,  30  FR  11269) 

**During  the  performance  of  this  contract,  the  contractor  agrees  as 
follows: 

(1)  The  contractor  will  not  discriminate  against  any 
employee  or  applicant  for  employment  because  of  race, 
creed,  color,  or  national  origin.    The  contractor  will 
take  affirmative  action  to  ensure  that  applicants  are 
employed,  and  that  employees  are  treated  during  employment, 
without  regard  to  their  race,  creed,  color,  or  national 
origin^    Such  action  shall  include,  but  not  be  limited  to 
the  following:    employment,  upgrading,  demotion,  ot  trans- 
fer; recruitment  or  recruitment  advertising;  layoff  or 
termination;  rates  of  pay  or  other  forms  of  compensation; 
and  selection  for  training,  including  apprenticeship*  The 
contractor  agrees  to  post  in  conspicuous  places,  available 
to  employees  and  applicants  for  employment,  notices  to  be 
provided  by  the  contracting  officer  setting  forth  the  pro- 
visions of  this  nondiscrimination  clause* 

(2)  The  contractor  will,  in  all  solicitations  or  advertise- 
ments for  employees  placed  by  or  on  behalf  of  the  contractor, 
state  that  all  qualified  applicants  will  receive  considera- 
tion for  employment  without  regard  to  race,  creed,  color,  or 
national  origin. 

(3)  The  contractor  will  send  to  each  labor  union  or  represen- 
tative of  workers  with  which  he  has  a  collective  bargaining 
agreement  or  other  contract  or  understanding,  a  not ice »  to  be 
provided  by  the  agency  contracting  officer,  advising  the  labor 
union  or  workers*  representative  of  the  contractor's  commit- 
ments under  Section  202  of  Executive  Order  No.  11246  of 
September  24^  1963,  and  shall  post  copies  of  the  notice  in 
conspicuous  places  available  to  employees  and  applicants  for 
employment • 

(4)  The  contractor  will  comply  with  all  provisions  of  Executive 
Order  No.  11246  of  September  24,  1965,  and  of  the  rules,  regu- 
lations, and  relevant  orders  of  the  Secretary  of  Labor « 

(5)  The  contractor  will  furnish  all  information  and  reports 
required  by  Executive  Order  No*  11246  of  September  24,  1965, 
and  by  the  rules,  regulations,  and  orders  of  the  Secretary  of 
Labor,  or  pursuant  thereto,  and  will  permit  access  to  his 
books,  records,  and  accounts  by  the  contracting  agency  and  the 
Secretary  of  Labor  for  purposes  of  investigation  to  ascertain 
cor.pllnncc  vi  th  r.uch  rulcf;,  rr;^ulation«5  ^  and  orders  • 
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(6)  In  the  event  of  the  contractor's  noncompliance  with 
the  nondiscrimination  clauses  of  this  contract  or  with 
any  of  such  rules,  regulations,  or  orders,  this  contract 
may  be  cancelled,  terminated  or  suspended  in  whole  or  in 
part  and  the  contractor  may  be  declared  ineligible  for  fur- 
ther Government  contracts  in  accordance  with  procedures 
authorized  in  Executive  Order  No.  11246  of  September  24, 
1965 »  and  such  other  sanctions  may  be  imposed  and  remedies 
Invoked  as  provided  in  Executive  Order  No.  11246  of 
September  24,  1965,  or  by  rule,  regulation,  or  order  of  the 
Secretary  of  Labor,  or  as  otherwise  provided  by  law. 

(7)  The  contractor  will  include  the  provisions  of  Paragraphs 
(1)  through  (7)  in  every  subcontract  or  purchase  order  unless 
exempted  by  rules,  regulations,  or  orders  of  the  Secretary  of 
Labor  issued  pursuant  to  Section  204  of  Executive  Order 

No.  11246  of  September  24,  1965,  so  that  such  provisions  will 
be  binding  upon  each  subcontractor  or  vendor.    The  contractor 
will  take  such  action  with  respect  to  any  subcontract  or 
purchase  order  as  the  contracting  agency  may  direct  as  a 
means  of  enforcing  such  provisions  including  sanctions  for 
noncompliance:    Providing,  however .  That  in  the  event  the 
contractor  becomes  involved  in,  or  is  threatened  with,  liti- 
gation with  a  subcontractor  or  vendor  as  a  result  of  such 
direction  by  the  contracting  agency,  the  contractor  may  request 
the  United  States  to  enter  into  such  litigation  to  protect  the 
Interests  of  the  United  States." 
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APPENDIX  F 


CONnUCT  BETWEEN  THE  SCHOOL  DISTRICT  OF  THE  CITT  OF  FONTIAC  AND  CA8XHUFF 
ASSOCUTES  INC. 

1*    PARTIES  TO  THE  CONTRACT 

This  contract  eete  forth  the  relationship  between  The  School  District 
of  City  of  Pontiac,  Michigan,  and  Carkhuff  Associates,  Inc.,  Amherst, 
Massachusetts,  for  the  period  beginning  July  li  1973  through  June  30, 
W**,  for  services  and  products  provided  to  the  "Human  and  Computer 
Assisted  Career  Achievement  Skills  Program"  (formerly  "CCD!  Computer 
Assisted  Guidance  Program")  conducted  under  Part  C  of  Public  Law  90-576 
and  funded  through  the  Michigan  Department  of  Education  under  OE  Letter 
of  Assurance  (project)  No.  V-26l0^1-L,  Grant  Award  0B0-O-72-07**9,  the 
plan  being  dated  August  1972  (revised  February  1973)* 

2.    SCOPE  OF  SERVICES 

The  services  and/or  materials  which  Carkhuff  Associates,  Inc.,  agree 
to  provide  shall  be  directed  toward  the  accomplishment  of  general 
objectives  for  staff,  program  and  computer  as  stated  on  pages  5-13 
in  Appendix  A  for  "Plan  for  Phases  II  and  III"  and  the  specific  ob- 
.   jectives  stated  on  page  four  in  the  "Plan  for  Phase  III"  hereto  atta- 
ched as  Appendix  I  and  II  respectively,  and  made  a  part  of  this  agree- 
ment.   It  is  understood  that  the  teno  »«evaluation"  as  used  in  this 
agreement  shall  include,  but  not  be  limited  to,  data  gathering?  analysis 
and  interpretation  as  may  be  necessary  to  provide  guidance  to  the 
development  of  programs,  to  the  conduct  of  the  staff  training,  and  to 
the  development  of  computer  support  systems,  except  that  any  such 
activities  by  Carkhuff  Associates  shall  not  duplicate  nor  supplant 
nor  be  a  substitute  for  a  third-party  evaluation  as  provided  in  a 
contract  between  Dr.  Theodore  Ploughman  and  'Jhe  School  District  of 
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city  of  Poatiac  for  the  period  July  Xi  1973  through  June  30,  197^  Inclueive. 
Xt  la  further  understood  that  the  third-party  evaluator  ahall  have  ready, 
cooplete,  and  timely  access  to  data,  in  both  new  and  processed  fome,  and 
to  analysis  of  data  which  are  collected  and  analyzed  by  Carkhuff  Associates 
and  the  Pontiac  Research  9nd  Development  Department  under  terms  of  this 
'  agreement  and  which  are  necessary  for  the  third-party  evaluator  to  fulfill 
his  contractual  obligations  to  this  project* 

The  services  which  Carkhuff  Associates  will  provide  include  the  following: 

A.    Consulting  and  Training  -  75  days 

Human  Resources  Development  Skills  Training  will  be  conducted  for 
trainers,  1972-75  trainees,  1973-7^  trainees,  and  administrators. 
This  training  will  include  Interpersonal  Skills,  Educational  Skills 
and  Career  Skills  as  detailed  in  the  Art  of  Helping.  Art  of  Problem 
Solving.  Art  of  Teaching  and  Art  of  Developing  a  Career  by  Dr.  Robert 
Carkhuff.    Pre-post  training  measurements  will  be  made.    Also,  in- 
cluded as  part  of  training  will  be  onsite  classroom  observations, 
project  planning  and  followup  training. 

B»   Program  Planning  and  Development  -  32  days 

This  includes  planning  and  developing  the  following  training 
programs: 

1«    Trainer  programs 

2.  Trainee  programs 

3.  Observation  programs 

4.  Teacher-Counselor  support  programs 

%    Human,  Educational  and  Career  Modules 
6.   Administrative  Modules 
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OtiMr  progran  planning  eerrices  ineluda  the  following: 

!•   Asaietance  in  Developing  Cofflputerised  Occupational 
Infonsation  Retrieyal  Systea* 
*  2*   Evaluation  and  recoonendationa  for  model  lesson 

plan  developoentr  * 
-  3*   Riase  III  report  generation*  which  ineludea 

c 

dissenination  programs. 

C*   Materials  Service 

niis  includes  manuals,  books  (Art  of  Helping.  Art  of  Problem 
Solving.  Art  of  Teaching  and  Art  of  Developing  a  Career)  and 
ipeeifie  programs  as  they  become  appropriate  to  facilitate 
the  delivery  of  th**  above  services* 

P«   Administrative  Services 

Shis  includes  secretarial,  clerical,  communication,  billing 
and  correspondence  services* 

3*  CGMFENSATZ(»f 

The  fee  structure  for  Carkhuff  Associates  services  is  as  follows: 
A*   Consulting  Services  «  S150  per  man  per  day  (8  hours)  *^ 
1*   Evening  work  above  and  beyond  a  nonsal  work  day  io 

e 

charged  at  time  and  one  half* 
2*   Traveling  time  to  and  from  a  work  site  is  charged  as 
a  consulting  service* 


^e  $150.00  per  man  day  rate  had  been  previously  approved  by  Mr* 
Otis  Roberts  on  November  1,  197a»  based  on  the  rational  presented  by 
Mr*  F.W*  Nunea  in  a  letter  to  Dr*  Sidney  High  dated  August  18,  1972* 
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B*   Program  Pevelopaent  Services  •  U50  per  Ma  per  8-hottr  day* 
C.   Materials  at  a  per  Itea  rate* 

AdBinistrative  Service  at  253^  of  the  total  of  the  above 

three  services* 
E*   Dailjr  ejcpensee  at  850  per  nan  per  day* 

F*   Air  travel  expenses  at  cost.   Ihese  expenses  wlU  be  propor- 
tioned over  all  Michigan  projects  where  appropriate, 
nie  fee  estlsate  for  the  proceeding  services  is  826,312*00. 

Consulting  and  Training  Visits  ®  8150  (75  days)  ^  •^•fS*^ 
Progran  Development  Services  Q  8150  (32  days)  4,«X)*00 
Materials  (approx*  80  people  9  825  average)  h^*^ 

818*050*00 

Administrative  expenses  «  259^ 
Daily  Expenses  Q  850  (75  days) 

Air  Travel  Sxpenses  d  8100  (20  days)  2,000.00 

12q«312*0O 


4.    MEXBQD  OP  PAYMENT 

Upon  approval  of  this  contract  by  the  0*S.  Office  of  Education  and 
the  Michigan  State  Department  of  Education,  Carkhuff  Associates 
will  be  paid  in  monthly  inatallnents  for  services  actually  per- 
fonsed  and/or  products  delivered.   The  final  installxaent  shall  be 
109£  of  the  total  amount  and  will  be  paid  upon  receipt  and  approval 
of  the  final  report.   The  total  amount  of  this  contract  shall  not 
•xceed  TWenty-eight  Thousand,  !Diree  Hundred  and  Twelve  Dollars 
(828,312).  . 


CANCELLATION 

Shis  contract  may  be  cancelled  by  either  party  with  30  days  written 
notice.  341 


€•    fiQSAL  OPPORTDNITr  CIAUSE 

Carichuff  Associatest  Inc.*  in  the  perfomanee  of  this  contract,  as 
weeded,  will  conply  with  the  Equal  Opportunity  Clause  -  BEV  386 
(Section  202,  Executive  Order  112<>6,  Septeaber  2<f,  30  FB 

11269)  as  revised  May  1966*    As  certification  to  that  effect,  a 
copy  of  that  clause,  signed  by  the  president  of  Carkhuff  Associates, 
Xne*,  is  attached  as  Appendix  IH  and  made  a  part  of  this  agreenent* 

7.    AmiNISTRATIVE  CONTROL 

It  is  agreed,  that  the  School  District  of  the  City  of  Pontiae 
ebaXl  retain  administrative  control  over  the  provision  of  services 
and/or  naterials  under  this  agreeoent* 

$•    OWNERSHIF  OF  MATERIALS 

Ownership  of  the  final  foro  of  any  material  or  processes  uniq;uely 
developed  and  produced  for  use  in  this  project  is  held  by  this 
project.    The  term  "final  form  of  any  material  or  processes" 
refers  to  graphic  or  oudial,  verbal  or  nonverbal  material,  measuring 
instruments,  devices,  or  processes  or  other  products,  or  any  combi'^ 
nation  thereof,  which  is  necessary  to  the  transportability  of  all 
or  any  part  of  the  final  products  of  the  project  in  other  school 
districts  or  schools  within  the  Pontine  School  District  and  to  the 
affective  and  economical  implementation  of  all  or  any  part  of  those 
final  products  in  those  school  districts  or  schools*   The  deter* 
■ination  of  "necessary",  as  used  in  the  previous  statement,  shall 
be  made  by  the  interpretation  of  trials  and  pilot  tests  of  the 
products  and  processes  developed  to  neet  the  project  objectives 

o      wS/oT  by  the  reasonable  judgment  of  the  project  director  mnd  htr 

m:  342 
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Kothing  in  the  above  statenents  iiqaies  toy  claim  against  the 
••Mtttial  technology  on  which  the  naterials  and  processea  nay  be 
based,  nor  against  any  intermediate  materials  or  processes  which 
Bay  have  been  developed  in  arriving  at  the  final  form  of  those 
tsaterials  or  processes,  nor  against  any  basic  technology  which 
Carkhttf f  Associates,  Inc. ,  may  have  developed  in  the  course  ol. 
this  project  or  as  a  result  of  having  been  involved  in  the 
project. 

Shis  agreement  becomes  in  force  upon  signature  of  both  parties  and 
approval  of  the  U.  S.  Office  of  Education. 


cmaoF?  ASSOCIATES,  mc.  ras  sohdol  district  of  the 


cirr  of  fontiac 
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Appendix  I IX 


EQUAL  EMPL0Y>1ENT  OPPORTUNITY 
(Section  202.  Executive  Order  II2A6.  September  24.  1965,  30  FR  11269) 

"During  the  performance  of  this  contract,  the  contractor  agrees  as 
follows: 

(1)  The  contractor  will  not  discriminate  against  any 
employee  or  applicant  for  employment  because  of  race.  ' 
creed,  color,  or  national  origin.    The  contractor  will 
take  affirmative  action  to  ensure  that  applicants  are 
employed,  and  that  employees  are  treated  during  employment, 
without  regard  to  their  race,  creed,  color,  or  national 
origin.    Such  action  shall  include,  but  not  be  limited  to 
the  following:    employment,  upgrading,  demotion,  or  trans- 
fer; recruitment  or  recruitment  advertising;  layoff  or 
termination;  rates  of  pay  or  other  forms  of  compensation; 
and  selection  for  training,  including  apprenticeship.  The 
contractor  agrees  to  post  in  conspicuous  places,  available 
to  employees  and  applicants  for  employment,  notices  to  be 
provided  by  the  contracting  officer  setting  forth  the  pro- 
visions of  this  nondiscrimination  clause. 

(2)  The  contractor  will,  in  all  solicitations  or  advertise- 
ments for  employees  placed  by  or  on  behalf  of  the  contractor, 
state  that  all  qualified  applicants  will  receive  considera- 
tion for  employment  without  regard  to  race,  creed,  color,  or 
national  otigin. 

(3)  The  contractor  will  send  to  each  labor  union  or  represen- 
tative of  workers  with  which  he  has  a  collective  bargaining 
agreement  or  other  contract  or  understanding,  a  notice,  to  be 
provided  by  the  agency  contracting  officer,  advising  the  labor 
union  or  workers*  representative  of  the  contractor's  commit- 
ments under  Section  202  of  Executive  Order  No.  11246  of 
September  24,  1965,  and  shall  post  copies  of  the  notice  in 
conspicuous  places  available  to  employees  and  applicants  for 
employment . 

(4)  The  contractor  will  comply  with  all  provisions  of  Executive 
Order  No.  11246  of  September  24,  1965,  and  of  the  rules,  regu- 
lations, and  relevant  orders  of  the  Secretary  of  Labor. 

(5)  The  contractor  will  furnish  all  information  and  reports 
required  by  Executive  Order  No.  11246  of  September  24,  1965, 
and  by  the  rules,  regulations,  and  orders  of  the  Secretary  of 
Labor,  or  pursuant  thereto,  and  will  permit  access  to  his 
books,  records,  and  accounts  by  the  contracting  agency  and  the 
Secretary  of  Labor  for  purposes  of  investigation  to  ascertain 
corr.pl l.nncc  villi  ?uch  rules,  regulations,  and  orders. 
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(6)  In  the  event  of  the  contractor's  noncompliance  with 
the  nondiscrimination  clauses  of  this  contract  or  with 
any  of  such  rules,  regulations »  or  orders,  this  contract 
may  be  cancelled,  terminated  or  suspended  in  whole  or  in 
part  and  the  contractor  may  be  declared  ineligible  for  fur- 
ther Government  contracts  in  accordance  with  procedures 
authorized  in  Executive  Order  No.  11246  of  September  2A, 
1965,  and  such  other  sanctions  may  be  imposed  and  remedies 
invoked  as  provided  in  Executive  Order  No.  112A6  of 
September  24,  1965,  or  by  rule,  regulation,  or  order  of  the 
Secretary  of  Labor,  or  as  otherwise  provided  by  law. 

(7)  The  contractor  will  include  the  provisions  of  Paragraphs 
(1)  through  (7)  in  every  subcontract  or  purchase  order  unless 
exempted  by  rules,  regulations,  or  orders  of  the  Secretary  of 
Labor  issued  pursuant  to  Section  204  of  Executive  Order 

No.  11246  of  September  24,  1965,  so  that  such  provisions  will 
be  binding  upon  each  subcontractor  or  vendor.    The  contractor 
will  take  such  action  with  respect  to  any  subcontract  o*: 
purchase  order  as  the  contracting  agency  may  direct  as  a 
means  of  enforcing  such  provisions  including  sanctions  for 
noncompliance:    Providing,  however ,  That  in  the  event  the 
contractor  becomes  involved  in,  or  is  threatened  with,  liti- 
gation with  a  subcontractor  or  vendor  as  a  result  of  such 
direction  by  the  contracting  agency,  the  contractor  may  request 
the  United  States  to  enter  into  such  litigation  to  protect  the 
interests  of  the  United  States." 


HEW- 386 
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MODUIi:  I    TEST  I 

Terminal 
Obj*  Measured 

1,1     1.    Write  10  questions  using  the  format  •'Who       (Who)       *\  and  answer 
each  of  the  questions  with  at  least  2  job  titles. 

2.1     2»    List  and  classify  at  least  20  jobs  under  each  of  the  headings 
People  and  Things. 

5.1  ,5.    Make  a  chart  which  has  k  categories  under  People  jobs  and  place  at 

least  5  jobs  in  each  category. 

5.2  Make  a  chart  which  has  ^  categories  under  Things  jobs  and  place  at 
least  5  jobs  in  each  category. 

MODUXS  II     TEST  II 
^.1     1.    Make  a  chart  which  contains  all  8  categories  under  People  and 

!Ibings  and  5  educational  levels.    Show  how  you  would  use  numbers 
to  determine  your  favored  cell. 

MODULE  III     TEST  III 
6.1     1.    List  at  least  5  people  and  5  other  job  information  sources. 

2.  List  your  2  job  titles  and  list  at  least  k  specific  job  iafonnation 
sources  for  each. 

MODULE  IV     TEST  IV 
1.    Make  a  Job  Requirement  Chart,  develop  a  question  for  each  cell 
and  provide  a  quantified  answer  for  each  question. 

MODULE  V      TEST  V 

8.1     1.    List  at  least  5  quantified  values  under  each  of  5  headings. 
10.2     2.    Make  a  Career  Decision  Making  Chart  and  compute  a  job  score  for 
at  least  2  jobs. 

3.  Compute  your  ideal  job  score. 

k.    Compute  your  job  favorability  score  for  each  of  2  jobs  and  make 
a  statement  which  describes  what  your  numbers  mean. 


346 


MODULE  VII     TEST  VII 
1.   Make  a  self  evaluation  chart  and  rate  yourself  on  each  of  3 
job  skills, 

15.1     2.    Identify  a  skill  which  you  do  not  have  and  write  a  progran 

that  you  would  we  to  learn  how  to  do  the  skill. 
1^.1     3.    Wrtte  a  principle  for  each  of  at  least  3  job  skills. 

MODULE  VIII     TEST  VIII 
15.?     1.    Using  a  Career  Decision  Making  Chart,  explain  how  new  information 
can  affect  favorability  of  a  job. 

MODULE  IX     TEST  IX 
16.3     1.    Using  a  Decision  Making  Chart »  show  and  explain  how  a  change 

in  values  can  affect  your  job  favorability  score. 
17,1     2.    List  at  least  2  promotional  possibilities  for  your  first  job 

alternative. 
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APPENDIX' H 

CAST  SUMNARir  qUESTIDN 


Student  Nane 

Teacher  Name  •  ' 

School   


*  ^  career  plan  is  an  outline  of  the  things  you  would  do  to  get  ready 
for  a  career* 

-  Think  about  all  the  steps  you  would  take  to  develop  your  career  ^lan* 

*  tfyite  each  of  these  stops  down  in  the  order  you  would  take  then* . 

-  Start  from  a  position  of  having  no  career  plan* 

*  8how  an  example  of  each  step  you  would  take  to  develop  a  eareer  plan* 
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Goals  of  Curriculum 


1,0   Expanding  iob  titles  to  chooe©  from  using  the  interrogative 
WHAT  and  WHO. 

r.O    Expandinc  and  classifying  jobs  under  headings  of  people  or 

thincc  on  the  basis  of  what  people  do. 
3.0   Expanding  and  classifying  jobs  by  interest  area  for  both  people 

and  thing  jobs. 

^.C   Expanding  job  awareness  by  classifying  jobs  in  one  or  more  of 

eight  interest  sureais  according  to  educational  levels. 
5.0   ChooainK  a  limited  set  of  occupations  to  explore. 
6.0    Developing  awareness  of  job  information  sources. 
7.0   Developing  and  using  questions  to  obtain  information  about  jobs. 
8.0   Clarifying  and  identifying  occupational  values  physical,  intellec- 
tual and  emotional  (What*8  important  to  me). 
9.0   Ordering  of  occupational  values. 
10.0   Evaluating  job  based  on  personal  occupational  values* 
11.0   Identifying  specific  skills  througji  personal  interview* 
12.0   Evaluating  oneself  in  relation  to  the  job  requirements. 
13.0   Developing  and  carrying  out  programs  for  acquiring  needed  occupatii 
al  skills. 

lh,0    Investigating  principles  that  relate  performance  to  goals  to 

human  benefit. 
15.0   Reevaluating  job  with  regard  to  new  information. 
16.0   Reevaluating  occupation  with  regard  to  change  of  values. 
17.0   Investigating  job  with  regard  to  promotional  possibilities. 
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Date  

HUMAN  ACHIEVEKENT  SKTT.T.S  -  PRE-TEST 

1. 

Step  X.    Read  the  following  stimulus  expression  froa  a  12-year  old 
girl,    "I  try  to  do  my  hoaevork,  bit  that  teacher  gives  us 
such  stupid  stuff,  nobody  can  do  it.*' 

Step  2.    Write  a  response  directly  to  this  student,  just  as  you 
would  respond  in  real  life* 

Fonnulate  your  response  to  help  the  student  explore  where 

he  is  in  terms  of  i  j.a  sutuation. 


Step  3.    Read  the  following  stimulus  expression  from  a  15-year  old 

boy.    "I've  always  wanted  to  be  an  engineer,  taut  now  I'm 

finding  I  can't  even  do  my  algebra." 
Step  ^.    Rate  each  of  the  following  alternative  responses  in  terms 

of  how  effective  it  is  in  helping  the  student  explore  where 

he  is  in  terms  of  his  situation. 

Use  this  scale  to  rate  each  response  separately.    You  may 
use  half  point  intervals  if  necessary  (1.5«  2*3«  3*3*  etc.). 

5.0  Extremely  Effective 

U,0  Very  Effective 

3.0  Effect  A  -e 

2.0  Very  Ineffective 

1.0  Extroiely  Ineffective 
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step  5.    Alternative  Hesponsea  Your  Rating 

1.  You  feel  discouraged  !•  _____ 

2.  You  better  buckle  down  in  there 

or  you'll  never  make  it.  2»  ^ 

3.  You  feel  discouraged  because  you 
know  algebra  is  important  and 

you're  not  doing  well.  3»  _„_^ 

^.    You  should  explore  all  the  ways 
you  can  get  help  in  algebra  so 
you  can  do  better.  , 

5.    You  feel  sad  because  things  are 

going  badly  for  you  in  algebra.  5-   
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2. 

Step  1.    Read  the  following  stimulus  expression  fr««  a  l4-yesr  old 
girl.    "I  never  know  if  tihat  X  do  is  good  or  bad.  You 
never  tell  oe*" 

Step  2.   Write  a  response  directly  to  the  student  just  as  you  would 
respond  to  him  in  real  life* 

Fonmilate  your  response  to  help  the  student  understand 
where  he  is  and  where  he  wants  to  be  in  regard  to  this 
situation* 


Step  3.  Head  the  following  stimulus  expression  from  a  12-year  eld 
boy*  "They're  always  picking  on  me,  banging  up  on  me  and 
pushing  me  around.    I  don't  even  want  to  go  to  school  anymore.'* 

Step  ^.    Rate  each  of  the  following  alternative  responses  in  terms  of 
how  effective  it  is  in  helping  the  student  understand  where  he 
is  and  where  he  wants  to  be  in  regard  to  his  present  situation. 
Use  this  scale  to  rate  each  response  separately.    Tou  may  use 
half  point  intervals,  if  necessary  (1*9,  2.3i  3»5«  etc.). 

3.0  Extremely  Effective 

U.O  Very  Effective 

3.0  Effective 

2.0  Very  Ineffective 

1.0  Bxtroaely  Ineffective 

Step  3.    Alternative  Issponses  Your  Rating 

1.    You  feel  scared  because  you  can't 

handle  thtm  and  you  know  you  need 

to  learn  to  haiuUe  them.  1* 
2*    You  feel  scared  because  you  don't 

know  how  to  stop  them.  2* 
3*   You  feel  shook-up  because  th^ 

might  hurt  you.  3» 
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Alternative  Responeea  (cont.) 


Your  Rating 


^,    Ycu  fei»l  frightened  because  you 

can't  deaX  with  them  effectively.  ^» 
5.    You  feel  afraid  because  they  are 

always  coming  after  you.  ^. 
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3. 

Step  1.    Bead  the  following  stimuluo  expression  from  an  l8-year  old 
boy.    **I'm  interested  in  working  with  coaputers  and  X  know 
there  are  jobs  available  both  with  and  without  college.  But, 
I  don't  know  which  would  be  best  for  ne,    I'll  be  graduating 
soon  and  have  to  decide." 

Step  2.    Write  a  response  directly  to  this  student  just  as  you  would 
respond  in  real  life. 

Formulate  your  respon've  to  help  the  student  understand  the 
steps  he  must  take  ^o  get  from  where  he  is  vo  where  he  wants 
to  be. 


Step  ?.    Read  the  following  stimulus  expression  from  a  13-y«ar  old  boy. 
"If  I  don't  make  it  this  last  marking  period,  my  Dad's  sure 
going  to  get  me.    Can  you  help  me?" 

Step  ^.    Bate  each  of  the  following  alternative  responses  in  terms  of 
how  effective  it  is  in  helping  the  student  to  understand  what 
steps  he  should  take  to  get  from  where  he  is  to  n^ere  he  wants 
to  be.    Use  this  scale  to  rate  each  response  separately.  You 
may  use  half  points-intervals,  if  necessary  (l.5«  2*^,  3»!?«  etc.). 

5.0  Sxt^-emely  Effective 

'♦.O  Very  Effective 

3.0  Effective 

2.0  ^'  ry  Ineffective 

1.0  Extremely  Ineffective 
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Step  5*    Alternative  Regponece  Year  Bating 

1.  You  feel  fri^tened  beccuoe  ymi 
can't  see  your  way  clear  and  yet 
you  know  it  has  to  be  different 

this  tern.  1. 

2.  You're  scared  because  you  think 
nuQrhe  you  don't  know  how  to  do  any 
better  and  now  you  have  to  learn  to. 
For  oe  to  help  yout  we  first  have  to 
explore  fVilly  the  situation  where  you 
are  nesslng  up  so  we  can  cooe  to 
understand  just  what  it  is  you  need 
to  help  you  nake  it.    Then  we  can  de- 
velop a  plan  for  giving  you  the  ^lls 

to  meet  your  needs*  2.  _____ 

3*    Z  don't  think  your  dad  will  really 

do  anything.  3» 

If  I  were  in  your  shoes,  I'd  really 

buckle  down  and  put  nqrself  on  a 

schedule  where  you're  studying  one 

hour  for  every  hour  you  spend  in  class.  ^» 
^.    You're  pretty  worried  because  your  dad 

is  really  putting  the  pressure  on  you.  ?• 
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Educational  Rosource  Dovelopnient 
Skills  Inventory  ' 


Kstfna;   ^  School: 


Subject:  Grade  Level: 

HoTOd  Address:  


Copyright^  1973  by 
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5 

Tcachinn:  Doliv'gry  Skills 

♦  # 

Educators  have  dcrmnstratcd  tliat  ono  critical  dimension  affecting 
student  achievement  is  the  student's  individual  learning  style.   Ihis  is 
to  say  that  all  students  do  not  Icam  efficiently  in  precisely  the  same  way. 
Rather,  research  indicates  that  individual  students  adopt  preferred  learning 
strategies.   Hie  quickest  learners  seon  to  have  mastered  several  preferred 
learning  strategies  that  enable  them  to  adopt  to  different  teaching  styles. 

Researdi  into  the  developnr?nt  of  Human  Resources  indicates  that  a 
similar  phenomena  can  account  for  a  predictable  portion  of  teacher  effective- 
cess.   S5[)ecifically,  effective  teachers  have  developed  a  large  quantity  of 
teadiing  strategies,  curriculum  development  sldLlls  and  classrocxn  management 
skills  to  delivvsr  tlieir  programs.    Hiis  repertoire  of  teaching  delivery 
odLUs  enables  them  to  individualize  their  deliveiy  of  the  curriculum  to 
fit  student  leaniins  styles,  thereby  increasing  their  probability  of  meeting 
individual  student  performance  objectives. 

'  this  item  is  designed  to  give  you  an  opportunity  to  demonstrate  your 
teaching  delivery  skills. 

,  On  the  following  pages,  you  are  to  develop  a  lesson  plan  for  a  lesson 
voQ  could  teach  tonorro'.v.   You  are  to  shcr.v  the  methods  you  would  use  to 
deliver  that  lesson  as  well  as  the  classroom  management  procedui'es  you  \\'ould 
use  to  insui*e  the  dclivciy  of  that  lesson. 
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X.   Lesson  Topic: 


n.   ObjoctiVo  of  Tx^pson: 


III.   Procedure  and  Methods: 


Lesson  Plan  \ 
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IV.   C3assroom  M>inaf;anont  for  I/.^sson: 


V.   Ikj/r  you  plan  to  evaluate  lesson: 
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BEST  COPY  AVAIIABUE 

Appendix  h 


CAST  -  Materials  Developed 

The  followini^  raatcriale  listed  under  Homan  numeral  I  vrere  developed 
under  the  CAST  project  and  are  available  from  the  sources  listed  under 
Ronan  numeral  II. 

I.  CAST  Katerials  (These  are  bound  separately  but  should  bo  used 

as  one  because  of  the  cross  reference  of  the 
appendices) 

A.    Phase  III  Lesson  Plan  Manual 

Livsson  Plan  Manual  I  Junior  Hich 
Lesson  Plan  Manual  II  Lower  Elementary 
Lcpfjor.  Plan  Manual  III  Upper  ELeaentary 

3.    Staff  I'^servics  Training  Pro.'^ant  Manual 

C.  CAST  Tt'chiical  Report 

D.  Phacc  III  Final  iieport* 

II.  Sourc2fi  of  Mr.toi'iftls 

Hft'ir  you  hav-*  s,cnt  in  your  request  for  these  materials 
an  ebstract  will  be  sent  out  first  with  a  number  for 
.ictual  o^dcrin'j  of  the  nuterialR. 


A 

I  M 

3 

N  A 

SEA 

S 

S  T 

S  S  T 

T 

T  Z 

TEE 

2 

R  a 

R  A  R 

A 

U  I 

A  R  I 

C 

C  A 

CCA 

7  L 

7  II  L 

I  S 

S 

c 
:i 

A 

L 

Center  for  Vocational  Education* 
Ohio  State  University 
i960  K*»nny  Road 
Columbus,  Ohio  *f5210 


National  Network  for  Curriculum  Co-Ordinator 
Vocational  and  Technical  Education 


7  Locations: 
1* 


Vocational  Curriculum  and  Media  Center 

Division  of  Vocational  Education 

??3  W.  State  Street 

P.  0.  Box  2019 

Trenton,  New  Jersey  03625 
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2.    InstruetionaX  Materials  Laboratory 
trniverslty  of  Kentucky 
Research  Foundation 
Lexington,  Kentucky  kO%t6 

^*    BCU  and  Curriculum  Co-ordinating  Unit 
Mississippi  State  University 
State  College,  Mississippi  ]$9762 

k»    CurrieuXum  Manageir  Center 

D4.vi8iQn  of  Vocati.  ^  and  Technical  Education 
1032  Outer  Park  Drive 
Springfield,  Illinois  62706 

5.   The  Currioulua  and  Instructional  Material  Center 

State  Department  of  Vocational  •&  Technical  Assoc i&t ion 
151?  V.  6th  Avenue 
StiUwater,  Oklahoma 

6*    Curriculum  Management  Center 

California  State  Department  of  Education 
1025  P  Street 

Sacremento,  California  93^1^ 

?•    Vocational  Curriculum  Center 

Department  of  Vocational  and  Technical  Education 
216  Old  Capitol  Building 
Olympia,  Washington  93^1 
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Deacrlption  of  AIDS 
(Aeseasnent  of  Inatnicttonal  Dgliv»ry  System) 

Reviewing  Monitoring  Syateins  - 

After  on  investigation  of  the  Student  Achievement  Monitoring  (SAM), 
which  is  a  management  system  under  development  by  Oakland  Intermediate 
School  District,  it  became  evident  that  the  time  schedule  for  impleoen- 
tation  was  clearly  outside  th**  Career  Achievement  Skills  Training  project 
duration.    Therefore,  in  order  to  monitor  the  acquisition  of  the  Career 
Achievement  Skills,  a  system  referred  to  as  AIDS  (a'  computer  process 
developed  by  the  Pontiac  Schools*  Rese>»rch  and  Development  Departiuent  for 
determininc:  where  a  student  stands  in  regard  to  accepted  educational  goals 
or  objectives.)  was  modified  from  its  use  with  basic  skills  to  Career 
Achievement  Skills.    AIDS  provided  information  to  the  students,  teachers  and 
Project  Director  as  to  how  effectively  the  Career  Achievement  SkUl  objectives 
had  been  delivered  to  students. 

Inplementint!;  AIDS  - 

Several  steps  v-ere  included  in  this  monitoring  process.    First,  each 
ovpcrinontrvl  nnd  -iontrol  croup  in  the  Career  Achievement  Skills  Training 
prograr.:  was  pro  .tnd  poet-tested.    Secondly,  the  tests  were  scored  and  the 
data  keypunched.    Thirdly,  the  computer  program  grouped  items  together  which 
were  measurinc  part  of  th«  sane  objective  or  skill.    Finally,  the  data  was 
qnalyred  and  £«  conputer  printout  produced  which  described  the  student  popula- 
tion in  tome  of: 

a.  Pro-post  scores  on  each  of  the  Career  Achievement 

Skills  objectives, 

b.  total  scores  for  each  student  on  the  pre-pose  tests,  and 

c.  indication  of  mastery  level  for  each  Career  Achievement 
Skills  objective  by  placing  students  in  the  following  groupst 

1.  did  not  know  it  on  pre  and  did  not  learn  it, 

2.  did  not  know  it  on  pre  and  learned  it, 

3.  knew  it  on  pre  and  forgot  it,  and 
knew  it  on  pre  and  maintedned  it. 
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The  computer  then  deterrelnea  the  total  ntimber  of  students  that  grewi 
stayed  the  sane  and  those  that  lost* 

A  student  Career  Achievement  Skills  profile  was  then  printed  and 
returned  to  the  student.   This  consisted  of  a  listine  of  each  career 
achievement  skill  objective,  the  pw-test  score*  post-test  score  and  a 
Growth  statistic  -  the  difference  in  pre  and  post  score.    It  also  printed 
the  "jnfoup  o**  class"  averages  for  eawu  Career  Achievement  Skills  objective 
as  well.    This  told  the  student  his  or  her  level  of  performance  relative 
to  his  or  her  peers.    An  analysis  by  skill,  i.e.  group  of  objectives,  was 
then  performed  and  coinpared  to  the  pre-test  skill  attainaent  level. 
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Student  Outcotnes  and  Recommendations 

The  coal,  in  tems  of  time,  was  to  have  the  Career  Achievement  Skills 
results  bask  to  the  student  in  a  matter  of  a  few  days  after  post  tecting. 
Unfortunately,  the  test  used  was  so  constructed  that  it  required  extensive 
chockine  by  trained  personnel.    This  extended  the  time  needed  to  return  the 
cojftputer  outputs  to  weeks  instead  of  days* 

Feedback  from  the  teachers  indicated  that  the  students  were  excited 
about  the  form  in  which  the  data  was  reported  to  them.    For  most  students 
thic  v/a3  the  firist  tine  they  had  received  individual  results  in  the  form 
of  5stndont  profiles* 

It  becar.ie  ^  vidont  that  certain  things  are  extremely  important  regarding 
thin  type  of  tostinc  and  rcportine.    The  first  is  that  if  a  student  is  absent 
on  pre  and  post  tcct,  his  available  data  should  be  analyzed  anyway,  so  that 
he. 'she  has  a  record  of  the  career  achievement  skills  mastered.    Secondly,  the 
instraTent  (tent)  oust  bo  of  the  nature  that  will  allow  for  simple  interpreta- 
tion to  the  student.    Lastly,  as  with  all  testing,  the  data  must  be  returned 
in  a£  short  a  time  as  possible. 

Teacher  Outcomeg  and  Reconmendations 

This  system  also  served  the  teachers  and  counselors  by  describing  and 
quint ifyinR  how  effective  they  were  in  the  delivery  of  the  Career  Achievement 
Skills  objective.*?.    Teachers  and  counselors  could  use  the  computer  information 
to  help  students  and  themselves.    They  recocanended  using  the  information  con- 
tained in  the  output  to  assess  where  students  are  in  relation  to  the  Career 
Achievcnent  Skills  and  to  group  students  who  need  help  on  the  same  skills. 
Also,  they  suf^ostod  usin£  the  information  to  assess  what  parts  of  their 
losson  plans  or  delivery  need  improvement. 

Proi:ran  Outcor.es  and  Raca'ainendations 

for  the  [Tocxan  evaluation,  the  statistical  data  on  each  objective 
provided     basis  to  fui-ther  evaluate  and  summarise  the  effects  of  the  CAST 
proi^ran.    It  wns  rocornnended  to  continue  periodic  progress  evaluation  based 
on  statistical  analyses.    Fron  reported  information  modificlitiona  in  the  total 
r>i'Oj:ran  should  bo  made. 

For  r.oro  ir.rorration  on  AIDS  contact  r.r.  Al  Pavlish,  Pontiac  Research  and 
Svaluation  3<;partn:ont ,  Pontiac  Public  Schools,  POntiac,  Michigan. 
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Description  of  CADS  Student  Printout 
Students  name 

Job  code  Indicating  conbination  of  highest  preference  - 
For  example,  this  students  code  2^3  indicates  that 
his  job  preference  category  include  those  jobs  highest 
in  investieative  characteristics,  next  highest  in  social 
characteristics,  and  least  bluest  in  artistic  characteristics* 
-Int  -  2  and  Ed  L«il  3  indicates  the  student  marked  the  2nd 
interest  (outdoor)  area  circle  and  the  3rd  education  C  high 
school  plus  some  training)  level  circle  on  his  CADS  ansvrer 
sheet. 

In  thiP  section  all  the  jobs  falling  under  the  job  code  2^3 
are  printnd  out.    The  first  number  given  is  a  computer  number. 
The  three  letters  I  S  A  are  the  job  code  abbreviation'.  The 
next  nutnber  is  the  DOT  (Dictionary  of  Occupational  Titles  1965). 
The  next  number  indicates  the  level  of  education  as  indicated 
in  the  DOT  classification. 

The  same  job  code  is  used  only  in  a  different  combination  thus 
producinc  a  riew  job  list. 

Now  the  jobs  arc  printed  out  according  to  interest  area  (outdoors) 
and  education  level  (high  school  plus  training). 
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Langutge        -  l-ORTRAN'  IV 
Memory  -  16 K  1  byte  words 

Peripherals  -  Card  Read 

-  Line  Printer 

-  Randcu  Access  Disc  Storage  (200,000  Character) 

-  Timing        Limited  by  Printer  (1/0  bound) 

-  Availability       Limited  by  Copywrites 

Software        -  3  Programs 

Since  the  local  school  districts  computer  is 
primarily  a  remote  job  entry  device,  the  memory 
capacity  is  limited.    Therefore,  it  was  necessary 
to  write  3  seperate  programs  and  call  them  when 
needed. 

1)  Create  Disc  file  of  occupations 

2)  a.  Read  Student  Cards 

b.  Convert  Data  and  Determine  Preference 

c.  Create  Disc  file  of  Student  Results 

3)  a.  Read  Student  Data  from  Disc 

b.  Print  occupation  list  Holland 

c.  Print  occupation  list  ii^'^ 

Future 

Development  -  Produce  class  summaries 

-  Measure  Convergence  between  Holland  and  Rowe 

-  Localize  occupation  list 

-  Integrate  Internship  with  occupation  list 

-  Dtudent  characteristics/consistency,  etc. 
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I'ROCiRAMJ 

Name  -    BLDOCF  -  Build  occupation  file 

Input  -  Card  -      Occupation  description 

Output  -  Rundom  access  file  of  occupation 
Printer  file  of  Occupation 

Input  Format  -  Card 


LOIURlll 

NO  A   L.liar « 

DatJi  TvT>e 

1-3 

3 

Alpha  occupation  code 

Alpha 

4-10 

7 

DOT  (Including  decimal) 

Numeric 

11-50 

uccupation  title 

51-76 

26 

Blank 

77-79 

3 

Sequence  title  no. 

Numeric 

80 

1 

Update  field 

Numeric 

It  Format 

-  Random  Access 

Disc-F-20 

Location 

No.  Char. 

Description 

Data  Type 

1-3 

3 

Sequence  number 

Numeric 

4-83 

80 

Card  image 

Alpha 

This  program  creates  a  random  access  disc  file  which  is  accessed 
during  the  final  place  in  printing  the  student  profile.  The 
order  of  these  cards  is  determined  by  the  sequence  of  jobs  listed 
by  Holland  and  Rowe. 

The  job  codes  are  converted  to  equivalent  numerical  values.  These 
values  along  with  the  number  of  jobs  in  category  are  stored  in  a 
matrix  which  in  turn  are  used  to  create  relative  disc  addresses. 
Therefore  it  is  important  that  the  number  of  codes »  and  number  of 
jobs  within  each  code  be  carefully  determined  and  properly  set  in 
the  data  statement  in  the  student  profile  program. 
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PROGUAM  I  I 


Name 

Input 

Output 


ULDSMX  -    Build  Student  Matrix 

Card  "       Student  Date  (see  student  input  for  format) 

Disc  -       Random  Access -Converted  and  Raw  Matrix. 

(See  Program  III  for  format  of  Disc  file) 


Output  -  Printer  -  Converted  and  Raw  Matrix 


Wr: 
No.  ! 
to  I 

Lte 

>td5 

Jisc 

Call 
Std.  Pro 

START 


READ  STUDENT 
DATA  CARD 


Yes 


^ 


Convert  Matrix! 
to  Percent  t 


Determine 
Maximum  Values 


Writer  Printer 
Record 


Write  Disc 
Record 


A 


A 
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Input  Format  -  StMclcnt  \h\tP  Cards 
Computer  Assisted  Occupation  Search 


Column 


No.  Char. 


Description 


Data  Type 


1-  s 

5 

0-13 

8 

14-17 

4 

18-19 

2 

20-21 

2 

22-23 

2 

24-25 

2 

26-27 

2 

28-29 

2 

30-31 

2 

32-33 

2 

34-35 

2 

36-37 

2 

38-39 

2 

40-41 

2 

42-43 

2 

44-45 

2 

46-47 

^ 

c 

48-49 

2 

50-51 

2 

52-53 

2 

54 

55 

56 

57 

58 

5? 

60 

61 

62 

63 

64 

65 

Student  ID 
Last  Name 
First  Name 

Activities -Real  is tic 
Activities -Investigative 
Activities -Art is tic 
Activities-Social 
Activities -Enterprising 
Activities -Conventional 
Competencies -Realistic 
Competencies  - Investigative 
Competencies -Artistic 
Competencies -Social 
Competencies -Enterprising 
Competencies -Conventional 
Occupations -Real is tic 
Occupations- Investigative 
Occupations -Artistic 
Occupations -Social 
Occupations -Enterprising 
Occupations -Conventional 
Self- Estimates -Mechanical 
Self- Estimates -Scientific 
Self -Estimates -Artistic 
Self- Estimates -Teaching 
Self -Estimates -Sales 
Self- Estimates -Clerical 
Self -Estimates -Manual 
Self -Estimates -Math 
Self -Estimates -Musical 
Self -Estimates -Friendlines 
Self -Estimates -Managerial 
Self -Estimates -Office 


Numeric 

Alpha 

Alpha 

Numeric 

Numeric 
«i 

It 

tt 

ft 

tt 

tt 

tt 

tt 

tt 

tt 

t« 

tt 

It 

It 

It 

It 

It 

ti 

It 

It 

ti 

tt 

tf 

It 

II 

s  " 
It 

tt 


Optional 

66  1  Interest  Area  Rowc  Numeric 

67  1  Educational  Level  Numeric 
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PROGRAM  II 


The  primary  function  of  this  program  is  to  analyze  the  student 
responses  and  to  determine  or  calculate  the  three  highest  interest 
Areas.    This  is  done  by  producing  a  matrix  with  the  interest  areas 
as  the  columns  and  the  categories  -  activities »  competencies,  occu- 
pations, self  estimate  I  and  self  estimate  II  as  the  rows.  Since 
the  range  of  values  within  the  cells  is  a  variable,  this  raw  matrix 
of  response  is  converted  to  percents  in  what  is  called  the  converted 
matrix.    Totals  for  both  matrices  are  calculated  and  printed  as 
marginals.    The  computer  then  selects  the  three  highest  values  and 
lists  them  under  the  matrix. 

The  row  totals,  column  totals,  name,  student  number,  interest 
area  and  education  level  (these  last  two  are  optional  used  in  the 
ROWE  classification)  are  then  written  to  disc  as  well  as  the  last 
line  of  the  printer  output.    This  data  is  then  read  by  the  last 
program  and  the  student  profiles  printed. 
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PROGRAM  III 


Input- 
Output- 


BLDSPH-     Building  Student  Profile 

Disk  "    Student  Data 

Disk  Occupation 
Printer  Idsting 


^y^pyt  Fornat'-     -See  Student  Input  card 

-Occupation  Category  Description 


Ottput  Format- 
Location 

6- 13 
U-17 

18-19 
20-a 
22-23 
2I1-223 

1-3 
4-6 

7- 9 

10-n 
12^ 


!^o.  Char. 

5 
8 

4 

2  (1) 
2  (1) 
2  (1) 
4 

No.  Char. 

3 
3 
3 

2 


Description 
Student  ID 
last  Name 
First  Name 
First  Choice 
Second  Choice 
Third  Choice 
Matrix  Output 

Description 

Job  Code  Title 

Blank 

Job  Code  Title 

equivalent 

Blank 

No.  Occupation  in 
Category 


Numeric 

Alpha 

Alpha 

N\cneric 

Numorie 

Numeric 

Numeric 

Data  T-.-Pu 
Alpha 

Numeric 
Numeric 

Numeric 


ERIC 


403 


PROGaAiM  III 

Student  Printer 
Profile 


ReaJ  Stmlt*nt 


Bulla  nuc  I 

AdIJress  Frow  • 
rntcrest  DiRit!i  | 


File  and  Print 
Occupations 


Dii^play 
Message 


Swap  Highest 
•no  SeconJ 
Digit  for 
Nov  Address 


Access  DiiKc 
Filo  and  Print 
Occwpations 


Displar 
Message 

"No  Job" 

Swap  Second 
•nd  Third 
Digits 


DispUr  ! 
Error  ! 
If  siago  I 


Establish 
Address  of 
Interest  Area 


Aeeest  Disc 
Bet  Occupation 


Diaplar 
Occupation 


PROGRAM  III 


The  disc  rccoi^d  established  in  Program  11  is  the  input  for  this 
program.    Once  this  data  is  read,  it  builds  a  search  key.    This  key 
is  a  three  digit  number  corresponding  to  the  three  highest  interest 
areas  established  in  Program  II.    The  highest  interest  area  is  the 
hundreds  position,  the  second  highest  is  the  tens  position  and  the 
third  highest  is  the  units  position. 

This  program  contains  a  data  statement  which  lists  the  valid 
interest  area  combination (Job)  and  the  corresponding  number  of 
occupations  within  the  combination  (NJOB) .    The  program  then  builds 
an  address  for  the  first  job  in  each  area.    Once  the  interest  areas 
are  combined  to  create  a  3  digit  number,  a  search  is  begun  to 
determine  if  this  number  is  valid^i.e.  is  there  a  job  list  for  this 
combination.     If  a  match  is  found,  the  corresponding  disc  address 
is  then  placed  in  the  key  and  the  disc  record  is  then  obtained. 
Since  the  number  of  jobs  is  known  for  each  valid  job  classif ication» 
sequenced  records  are  read  and  listed  under  that  classification. 
After  all  the  jobs  under  that  classification  are  listed  and/or  if 
it  turns  out  that  that  number  is  not  valid,  the  order  of  the  interest 
areas  are  changed,  i.e.  the  highest  level  is  changed  with  the  second 
level  and  the  search  begins  again. 

A  third  exchange  occurs  by  swapping  the  third  digit  with  the 
second. 

If  the  user  elected  to  respond  on  the  ROWE  classification, 
interest  and  education  level,  the  records  are  again  scanned  and  the 
matched  occupations  are  listed. 


405 


DHCK  SliTUP  l-OR  PROCESSING 


 *  EOF 

fCoad  [call 
Student 
Profile  


Program  III 

/i»rint  Student 
Profiles 


*  (call  std.  proj 


oad-Build 

Student 
Matrix  


Student 
Data  Cards 


Load-Builc. 
Occupation 
Xilfi  


Program  I 
Build  Disc 
File  of  Occupations 


Program  II 
Build  Student  Matrix 

Print -Write-Disc  Record 


*  The  current  version 
which  automatically 
Programs  II  and  III 


of  Program  II  has  a 
causes  execution  of 
are  a  single  job. 


call  statement  (INVOKE) 
Program  III.  Therefore 


BEST  COPY  AVAIUBLE 


S 

IS 

o 


u 

o  o 

l«  < 

•If  ^ 

X  o 


^  o  ^ 

M  *^  <^ 
Ul  «^ 

o  o  o 

p4  ^  CD 
K  lA  4 
Ui  ^  # 

X  oo 


^  oe  M 


X 

X  QC  M 


IV  O 

o  o 

IV  is# 
X  o 


* 

^  .a  ff* 
o  o  — 
Prt  ^ 

::  o  o 

•J 

a 

& 

Htf  ^ 

Q 

X  IV  < 

U 

vu  ^  «r 

X  o  o 

lA 

» <v  — 

X 

3 

«l  rr  M 

cr 

» 

o 

A. 

o 

< 

t 

ft. 

er  K 

* 

'J 

^  O  — 

Qt 

c 

—  o 

u  o 

IV 

o  o  <  ^ 

a' 

o  o 

ti   ^  K 

^  o 

•  O 

IV  < 

■r 

*V  —  B 

1«  IV 

O   •  9 

<-«  IV 

X  o 

K 

• 

< 

'V 

r 

r 

i«  < 

c 

^  er 

.  <^ 

c 

C 

u  M 

L 

uw  ^ 

& 

< 

w  c  or 

c  c 

O  Q  O 

1 

W 

a 

W  tte 

O  C«  UJ 

* 

u 

^  m  ^ 

** 

mm 

K  o  •« 

> 

> 

s 

O  IV 

^ 

• 

> 

o  o 

O  ru 

X  c  o 

.2 

O  ^  U/ 
IV       <  t  UJ  u 

C3    c  fi.     C  < 

H  ^  'v  a 
V  ^  # 


mm  mmt        mm  *m  ^  O 


4  or 


141 

z 


^  > 

<  14. 

-I  Ui 

a  o 

>c  Z 


> 


or 
u  a. 


10 


fit 

X 

Ui  S 
^  X 


o 


IV 
IV 


o 


u 

0 

0 

tc^ 

& 

0 

u 

0 

0 

X  « 

1^  fl-t 

^? 

> 

u 

ar  UI 

c  ^ 

|M» 

c 

as.  Mu 

:3  X 
ar  c 

or 

0 

w  X 

ar 

Mi 

4  X 

X  <P 

1-  ^ 

u.  < 

^  11^ 

^  0 

I* 

^  X 

0 

T 

u  « 

t  o 


ERIC 


• 


i 


n 

o 

D 


1^  » 


1^    •  »   »  » 

^  <r  «  tf\  o 

#i%  M 
<^    »  ii»   »  » 


ar 


» 

^  <^  ir%  «r  o 

> 

D 

■«  lA  1*^ 

•     iT  ^  ^» 

B  — 

<  U 

»  »  »  » 

«  CM  «^  fV  P 

r4a 

» 

O  B 

or  » 

*  fM  «o 

M 

o  o 

» 

» 

^    •  *   •  ^ 

C  B 

•  • 

ITMIN      <^  O 

tu  O 

^  «  M  4^  4^ 

U  O 

•      ^  m  ^» 

B 

c  *** 

>  ^ 

^   »  »   »  » 

Q  » 

or  e 

1/^  <  IT  O 

O 

^  IM 

» 

tJ  — 

—  «.«  IM  ^  oc 

o 

3 

C  • 

»  <V  ^  i|\  iO 

X 

O  • 

3  r 

rr  ^ 

c  •  •  •  * 

—  *.  >  UJ 

til 

o«  S 

a  » 

lA  in  O 

^  O  ^  B 

«J 

«v 

O  1-^  c  ^ 

T  • 

fSrf  X 

Ui 

« 

»  iT 

«>      ^  O 

V  O  U  «  IM 

Ui 

»  ^ 

mm  » 

(V    *   »    »  • 

■J        Wt  ^  mJ 

r  s 

»X 

^  *  ^ 

'mCi  ^ 

80  «^ 

C 

u.  » 

s&  • 

mm  ^  mm  ^  ^ 

7  B  e:  *^ 

o 

•  M 

»  fM  ^  lf\  ^ 

MO   *  Q  li» 

*  M 

o 

Uitt. 

4^    »   M    »  «k 

O  PSi  ^ 

K  n 

»  ^ 

^     ^               M«  ^ 

^  uj  ^  D  9 

(V  « 

0  U 

i>  ar  1*. 

^  » 

mm  » 

mm  mm  ^  \fi 

—  *^  •  •  C 

•UI 

*  (V  «^  w> 

^      C  c 

s  c 

•  » 

4A    i»   *    •  » 

r\*  S  1  — 

M  or 

•i  ^  T 

e       *\i  ^  ^ 

V  »  ^  »  c 

•C 

U 

X 

c  c 

c:  ^ 

M  «0  ^  ^  iT 

fy  ^  s  c  sr 

K  Ik 

o 

M  UI 

!j  ^  : 

•  > 

»  tN»  «r  ^ 

CI 

Ml  < 

o 

«v  X 

»  » 

»       »  • 

D 

,f  1^  iT 

» 

»      B  <  « 

Q 

*r  ^  i\  »t 

^   •  •'X  X  ^ 

o 

C 

r:  o'  CL 
t> 
^ 


^     p«  o  ^ 

<       «M  • 

I  ^  i    I  u« 

^  I  w  CO 

w*  «i  r  ^  « 

^  7  ;p  lA 

O  4«  ^ 

^  ^  V» 

r  a  ^  1^ 


4  I/) 

cr  3: 
C  f 


m^  * 

w  - 

T  > 

W 
J 

^  •» 

0 

l\i 

ft.  < 

•<  ft 

UI  < 
ft.  H- 


c  c 

C  I*  T 

*^  s  c 

3  3  C 
DUO 

<  ?  ^ 
■J  c  ^ 
a  V  > 

^  C  UI 
C  ft 

^  ^  < 

<  < 

*3  O 


m     ^  O  • 

"  —  —  c> 

2  INi  » 


O 


IVir     •N.    »U    m4  mm  fs,  ijj  UjU? 

O        •   *  <N|  O  —  KJ  <  m»  ^      OC  M  I 

•»(^t<KUB&C£V       •     »^  eB 

::*»«»»«^u.i.4.*-     SB     BC9Cs<«  e^i:o«»B 
«-  •»»»»*».»«rft>s;r>ft.ft.9.  rftarft.si^ft.>&  ou<t*' 


,  ^  IT  4? 
^    »  »  » 

X  ^  C  IV 
^  1^  ^  M  ^ 

•  *f  ^ 
»   »    »  » 

PV       (V  *  — 

—  ^ 

•  ^  A  O 
«r  »  »  *  » 

P.4     «v  in 

—  ^  IT  ^ 
» ^  ^  «o 

«•  ^        O  fy 


o 

ft*  %A 

^  lu 

OC 

o 

o 

ft) 

♦  u 

ftf\ 

as 

(V 

♦ 

o 

e 

<  & 

ft» 

* 

lA  » 

O  2 

M«  3 

|i« 

•  •>  X 

3  O  A« 

C  UI 

O  lAI 

O      M  |A 


ar  u# 


O      M  ^  e  I 


^  IV  IV  IV  <V  M  IV  M  IVIVIV 


ERLC 


403 


m 


o 


w 


O  I/I 
w  » 


5 
e 


mm  U> 

c  u 

»  u. 

nt  ui 

N>  |/> 

IL 

IS 

^  ♦ 

♦      ♦  ♦ 

• 

ft 

•  •  O 

*  O 

o     o  o 

O 

^  ^  U  • 

•  • 

^  « 

o 

• 

—  •tt* 

(L»  P  ac 

1^     oe  i/i 

^  «4  M»  ^ 

»     •  I/I 

fit  0 

c;  »  tf. 

(U  U  1.^  ♦ 

U  «  3 

u 

♦     ♦  ♦ 

—  —  o 

-> 

—  —  CO 

O     d  o 

o 

u 

(St  • 

O      Q  O 

o 

* 

* 

#      #  « 

« 

* 

U      U  4. 

•41     u#  or 

X 

O  <M  * 

«^  lA  M  •» 

^  M« 

o 

M  C 

o 

z 

mm 

M  — •  M 

—  (M 

•v  —  c 

C 

U.  C  3  Ui 

U»  C       Q  Ol 

^  OD 

Mi 

-1 

to 

* 

• 

> 

•> 

lAi 

a  -> 

UI 

uo 

o 

O  UI 

o 

Ml 

<  • 

• 

mm  tm 

mm 

Ml  p4 

0! 

o 

c 

•  e 

««« 

UJ 

o 

M 

• 

u 

U 

M  CJ 

apt  M 

Pm 

»«» 

oe 

M 

i  •« 

m 

U 

or 

^  o  • 

o 

o 

o  o 

o 

X  rst  fSi 

—  o 

H 

m*  mm 

^  ^  IM  K 

mm  ^ 

o 
o 


c  «  •» 
—     «  In  or 

y  _  _  ___  „_ 

>  K  W 


»»  S      O  •»  O  i-> 

d    Q    c  u 


 no  _ 


X  c  f-  c         •*  «  —  r—  IS  UI 

mm  mm  O^CM  •-^■i^CI^**  ^ 

c        2  <  tvM^^yc     0<x  —or 


O 


s  - 


ERIC 


s 

8 


<0 


1^  0* 


Ml  4> 


OQ 


o 

o 

o 

<v 

c 

o 

o 

o 

< 

X 

o 

o 

o 

« 

Ul 

Ji 

CD 

c 

c 

• 

C 

1** 

O 

O 

Ul 

rv 

(V 

o 

o 

O 

o 

M 

< 

c 

O 

o 

«»» 

Mi 

W* 

w 

O  -I 
K  O  ^ 

1^    (9    i»  141  a.  K 


u 

O 

o 

c 

u 

c  If 

H 

<S.  V      ?  U  CI  u 

o 

*>  ->  w 

u 

)C 

o 

« 

««» 

O 

<N 

o 

O 

o 

w> 

U 

u 

o 

&> 

1. 

c 

• 

X 

h 

«w 

p.* 

«r 

»  r  3  — 

M  «^  ^  <iO  ^ 

a. 

o  c 

^  mm  mm  am 

r 

c  c 

IT 

l; 

u 

O 

o  o  u  u 

O  oo  o 

O 

A  Li  ftA 

> 

c 

ii>« 

T  IT*  —  C 

K 

o 

« 

Q  .itf  (V  1^ 

W\  tf^ 

> 

LU 

V 

X 

O     u  o 

U  O  O  O 

X 

o 

c 

o 

O  C  S  9 

o  o  o  o 

S 

< 

At 

(Mi 

0«  «4t 

1^  ^  l<l  «^ 


«rt     M  «ir 

O 

Ml 

OB  f«  m  « 

If 

1^  m 

s 

O  «4  #i« 

Ml 

oc 

Ml 

M» 

Mi«  at 

4*  ^  M 

Of  Ml  Ml 

^      ly  ^ 

:r  ^ 

O  tf^ 

M  w  «« 

flP  Ul  il\  ^ 

M  «pl  ^ 

Mb  O  4* 

Mi  Ml 

O  #4  «"« 

OO 

Ul 

o 

s  <  < 

D  S  « 

«    ^  e 

«f  or  Qc 

•>«  ^  m 

o 

oo 

^»  a.  u. 

U  O  <M 

Ml  ^9  O 

<  A  (IN  «L 

UL  O  «^ 

< 

Ul  M 

O  ^  ^  p4 

mI 

«-  «^  i/i 

a 

^  */» 

C 

K 

1/^  1. 

O  i*N 

UN  *4  IM  ^ 

< 

«MI  #4  *« 

a 

to  0^  to  ^ 

E 

N»  r»  uj 

O 

AT 

^  ^  ^ 

u.  O  ^ 

(J» 

o  —  ^  ^ 

> 

«^ 

w 

X 

u 

IT  <St 

^  ^ 

ft: 

Im 

c 

or  Ul 

<t 

^  tf* 

mI 

O  <  O  tf» 

or  9 

ir 

<e  1^  IV  u 

1^ 

Ui  O  ^ 

fit 

O  ^ 

o 

ec 

oe 

Ul 

Z 

IT  fM 

(A  N» 

IT  »i«  ^.  O 

u  u 

X  a: 

V".  «i«  M*  0«  ^ 

•1 


«  c 
^  ^ 


.1 

o 

Ul 

> 

mI 

I/I 

at 

o 

c 

^  Ul 

^  a 

Ul 

Ml—  ^ 

at 

MO 

cm:  ^ 


tr  mI 


at  u: 
C  X 
Of  O 


Ml  Ul 

<  X 
>»  ^ 

o 

Q 


u 

•I*  «  ^  ^>  O  d 
^  «^  M  W  d  U 
<  O  ^  lA 
O  U  «^ 

a 


«t  <«N « 

IT 


X  U.  0"  «d  IM^ 
U:  C  4ik  «^  U 
^  ^  111  <n  i% 
<  O  O  «4  »^ 


lO  •-•  IV  < 


ERIC 


410 


IM 

a 


C 
C 


ar 


5 

«  o  V 
»  o 

S  U  < 

or  ;r  D 

c>  a 
1^  c  «^ 

•  D 

o  w 

u.  C 
IT  3  • 
»  C 

— 

-I 


^  IV 

I  I 

^  I  C 

u  V*  r 

J  > 
o 

_  o 
_  w  <t 
&  or  o 


r  < 
^  ft 


<^  D 

r  u 


< 


r  «^  y 
qr  K  —  — 


IT  ^ 


J       f  — 

Z  ^ 
V  —  ^w 

i  W 

r  < 
*  -» >  A 

^  M.  9(  fiC 


o 
c  z 


H 


X  at 
ar  or 


a  «> 
u.«  D 

«.!  3  U 
«  -I  3 

>  <  -ji 

>  «e 
c  > 

•  c 

<*  ^  • 
-*  <  ^ 

C    i^  — 

'  S  u- 

^  •»  T 

>  <  ^ 

>  < 
^  > 

«M  ::i 
X  u  ac 
V*  u 
^  '-u  X 
X  *rt  ^ 

u-  u.  u. 

r  z  I 


o 


I  o 


D 

4> 


X 

o 

'  INI 


^  — 


o 

9S 


IT  < 

C  (T 


<  • 

O  IT 


c  a  a 


c  c 
3  a 


o 

o 

0  ^ 


^  < 

ar  if  Of 


tf  or 


i«r  <  «tf  M 

k.  X 

or  or 


o 

<v  « 

:a 

Ui 

^  X 

>.  o 

or  <t 
C  UI 

fit 


< 


K  O 


04  ^ 


—  ^  O 

:^     a;  o 
»  CM  »  K  U^ 

fVi  ^  m«  • 

M  O  a 

» »- 


2 

o 


mm  ^ 

«  Itf 

^  K 
^  > 

U  M  ^ 
C  ft.  «. 


M  3  I** 

K  r:  ^  • 

%  mm 

O  K  K 

1.  U  ft.  ;k 


3  S  K 

|»  <  «M  O 

000^ 

U»»  C  ft. 


K  -» 

oiT^  M  m.  M 

(SI      1^  j; 

c  ^  o 
X  o  &  s  u 


o 


o 
or 
# 


o  — 


^  «t       ^  ^  OD 


O  O 


C  C 


1^  CC  0^ 
O  O  C» 


O  *-«  IV  m  ^ 


(V        ^  10     1^  00     o        fwi^^(n4>i^aDO^o«^<v    en  ^  in  «     do  ^ 


ERLC 


411 


BEST  COPY  AVAllABli 


P 


» 

SI 

4^ 

m 

C 

o 

U 

u 

n 

o 

K 
a. 

a. 
» 

* 

• 

r 

♦ 

*/> 

» 

> 

IX.  w 

—  ^ 

jr 

u 

w> 

a 

u 

a. 

ill 

• 

u  > 

• 

u 

IM 
1^ 


M 
M 


ft 

o 


C  ^  »  a    .J  u. 


V  c  ^ 
>  ^ 

-  O  r*'  ^ 


IN.  r  —  — 

M  ^  U  s  ae  ae 
ft  &  u  J(  ^  <^ 


C  9t  &  a' 

C  ^  O      X  J( 


1^ 


i:  £ 

mm  I* 

c  ^ 


c 

)i£  K  ^ 

>  ^  ft 
r-     —  i 


o 

^  fv  X 
C  u. 


O 


u 

o 

o  o 


> 


» 

» 

* 

* 

M 

»( 

fV 

ft 

K 

» 

oe  or 

lU  ^ 

u 

—  —  o 

in 

«  ft. 

c 

a  u  * 

^  «  » 

(V  U  <0  M 

» 

>     ^  M  Ui 

»  o     u.  ^ 

» 

M 

QC  ^      -J  4f 

» 

^  JC  ^ 

^  <  a  »^<* 

U  D     U  » 

♦ 

o  — 


2* 

•P.  1^ 

H»  U. 

C 


ft 


—        C        M  U«  M. 


er  oi 

M  Li. 


u 


a.  c 
—  c 


—  o 


^  —     at  ^  u 

a.  r  c 

flc     ^  C  a 

—  ^  flf  oc  z  — 


^  ft 


ui  uj  uj 


I  —  IC 

Li  <V 
ft 


I 

LI  lU 

I  3  ;d  •<-» 

'  2  Z  < 


&  C  %^ 

o  u 


of 

g 


^         ^^^talte  ^^^^^ 


^€>«^    <^  ^  «r  (IS  1^    so  c^ 


9  9 


^  ^  m 

1^  o»  ^  < 


ERLC 


412 


p 

O 


fV  9  ^ 
u  **«  « 
Ul  «^ 

o  o  e 
IV  4  M 

K  « 
#  « 

X  O  O 
«^  >Mi  •«»  m 

ha  fte  0«  O 


O  O  O  O  O  OQ  O 

X  o  o  o  o  ooo 


oc  cc 

W  Ul 
U.  Ul 
Ui  iii 


<  Of 


O  1^ 
iU  Ul 

u  u 

Ul  Ul 
flC  « 
Ul  IU 

Ik  Ik 

Ui  Ul 


lA       ^  4/) 


X 


w  «rf 


w 

u 

or  or  or  oe 

X 

Ul 

Ul  Ul  Ul  Ul 

< 

K 

(S  S  10 

s 

o 

-J 

X  X  Ik  X 
Z  Z  Z  £ 

o 

u 

^-  ^ 

r  r  ^  y 

o 

o 

< 

^  ^  U»  Ul 
T  T  7L  X 

< 

IJL»  Ul  Ul  Ul 

C 

^       fr»  H 

1^ 

IT 

a 

<  4  4  « 

X 

O 

o 

^  9>          tf>  f*» 

c 

K 

Ul 

^  ^  Pm 

%/%  ^ 

< 

^  c  K  K  ^»  ^* 

m 

o 

o 

r.  o  o  o  o  o 

a 

mm 

r. 

o 

1^  ^  ^ 

c 

^  <  ^  ^ 

r  <  *!  r  c 

U. 

iT 

^  ^  ^  ^  o  «o 

> 

T 

A 

r» 

C 

r  Q  O  S5  c  c 

Ul 

(A 

X 

z 

< 

nr 

ar 

tt«  ft«   MM  «■«  tow 

l> 

u 

2 

X 

c 

or 

Of  Iii 

AT 

< 

u 

pito.  fto.  ^  ^ 

•pi 

X 

or  ai 

^       0*  ^ 

tk 

a. 

a. 

ar 

i«  ^  ^  uj  u.  cr 

oe 

Ul  «c 

u 

CC 

f\i 

CD 

« 

y 

Ul 

z 

w 

M  «■ 

o 

o 

X  m 

» 

•< 

flu 

< 

K 

oe  Ul 

»- 

o  ^ 

o 

o 

. » 

I*. 

u^  1**  ^  —  «^ 

«  7^  O  ^  ^ 

or  Ul 

a 

u 

^  4>  |ib  fte  ^  ^ 

C  X 

or  c 

> 

e 

z 

;^ 

o 

OU  OOOC9 

oe 

t 

oomo 


^  A  III  < 
C»PP< 


4 


«|N  tr 


o  c 


4  S» 
C  O 


to 

O  O 


X  ^  ^  fv  « 

rui.z*«u»MXM 


Ul  oc 
X  ^ 

Ul  s 

4  a 


X 

mi  Ul 
<  X 
I*  ^ 

*v  o  a  -*  o 

Q  .rt  ||\ 

m0  4 
^  Z 

o 

o  4r 


pp< 


«0«k0p 


OM 


O 

^  tf\  Ul 
4ff  oe  UliL 
O  O  P  P 


•^P  iA  « 


Ul  ^  -* 

^    <^  Ul 

4  X  O 

o  oo  |» 

eg «  I 
P4  O  <^  In 

ir4  prt  1^ 


c  r  ^ 

<  ^  O  a 

OPOP 


«/t  «•«  M  *4  Oy 
Z  • 
U 

4-  Uf  P 
»•  ON— »«4) 
4  >  £  O  lb 
O  P  P  PP 

o 


4  ^  «a 

O  M  M 
^  0m  m4  ^  ^ 

Z 

Ul 

z  irv       N I 

U  £  O  P  PI 

P  Ik  < 
4  PPPPi 


IT  K 

M  ^  ( 


ERIC 


413 


UOOQOOOOOeoeOOOVOtfOOOOOOOOOOOOOOOOOOQOOOOUOOOOOOOOOOOOOQ 


z  XX  <     c       or  — 

9^  <  UU  ft.  Q  U 

X  ^  r  X  K    <ij  ^    or  Of  r 

&^<ac  \L.  sr  X        i£  ^        ^  uji  ui  a.  oro        uj  m 

7         or^ui  w^i^oi^t;^^^     ^ar        ui^x*nc<  A        &     XUv^ft>  0(t>»QrtfuJO  u 

^  mm  nu;        «t:^        *>*^  ^ii.u«4uia     u;    <  -j     «iujia.     ac     ii/<;AiuiXiii     <  U 

^  ^  •'^     ^  ^  t£  n     ec         ^  ^w;^«i^»«^^x««u.^u.     <(r^^Oa*     o     flC         u«<iar»Qe««*     ^     a     K^i>i»ft»  iiiSUi 

V  —  ^1*?-      -1^      C      w  •tX  —  —  O  —  -*«—u<<X^aC  •rt'^I-^U  lu  su  ^  ^  r  M.  X 

I  ::^^-»,,.^^-rf-j*-^u.  —  c-ii^cx  —  *-;p>2.u  cu-ju.o<ft.«»^XZ7^xxftcu.aa*;>u.cor«joziv>>c^«AiM 

i:r<-i-**^;;rckC<'L.<;.-«^o.i»-*u-;u.  2*-»r^--*««.:><wff.pi<<MU<<<*«uu.jiXXca;cu'(^A.u<QC*^«.^ 
••.•-»y^ab-^&&>/>i^<*^s:«.;i*.x::.e^';<9L^u  —  k  <<<;cci4.Ljt^«^^«ift.k.ft.xfr  La.<i/)uu.u.xae;9^)u^«ii«<^*<>»ui«jpz»* 

X  ^  ^  9  ip«  4V  O       O  ^      ^  <\i  M  ^  {>*  -41  o<  M  e       iM  aL  O  O  O  P       «<»  p«  O  <M  <M       «V  #^  •i*       ^      ^  O  pirt  «««  p  o  M 

Cfv««K^a  oca     &:.«.xcDx«oxft«v«cavor«orxa«CK  QrvepaD^v^ccapxxccccflCBCxcricaaDcotfQrad  flCxa&ca^flCflo^aD 


ERIC 


414 


• 

< 

• 

u. 
v» 

> 

tall 

w 

>  • 

& 

• 

3k 

or 

OK 

< 

.  * 

1  J 

c: 

•J) 

lit 

w 

«- 

1 

•  ** 

*  *• 

• 

& 

>. 

•A 

C 

ft 

4/* 

«: 

•  * 

> 

14 

* 

u 

«     a  ^  at 

A.        U.  X  < 


•    •  • 


mm  >  ^  ' 

>  K  ' 

r  «  9 


<  «.  m^ 

T  r» 
<  ^ 


ft  ✓  '*> 

fW^  ^ 

^  -* 
a  &  <« 
^  ^  ^ 

•  »  • 

^  <v  ^ 

!#•  «V 
^  <>•  1 
O 

9f 

i#  il^  wo 


^3  > 

^  V* 

^  — 
•  •  • 

Ci 

C*  <^ 

u 
i-  < 

ft  IV  6 

o 
^  ar  * 


<  {*  ^ 

^       V  w 

^  <i  c  ^ 


^  T 
ta»  %*  < 

^  ^  ^ 


> 

<  >  ^ 


a  or.  X  c 


^  o  o 


^  «l  <«J 

^  1/1 
«  ft  ar 
^  ^  «^  ^ 

«  flD  X  OD 


W  J*  *^ 

^  ta!  1^ 
^  %rl  ^ 

«  flr 
^  r  ^ 
«  «  c 


_  —  u  ^ 

^  ^  «  er  •* 

IT*  IV» 

CC  X. 

c  ^ 

)    •    •  • 

(T  ^  M 


<  ^ 

<^  ft 


1. 

X 


a 

✓ 

ft  ^ 

•K  «T  ibw  ^ 
ik.  ^  U« 
^  ^  ^ 

i«  flf  u 

.*  L  «  ^ 

er  9c  ^ 
i-     <  — 

a  s. 

f\.      i>i  «^ 

X     r  X 

N»        ^  ^ 


^  m  m  ^  mt)  C 


^  «\  1^  ;%  ^  >  ^ 


%A  m  w 
nr  Qc  n* 

«^ 
y  > 


oi  Ui  .  J  U. 

i/»  1/1 
a  rt  ar  ^ 
^  ^1  IM 

^  O  O 


U  ^ 

ft*  M 

X  or 
•  • 

or 
o  o 


X 

T 

I-  u 

3  > 
Uor 
— •  iu 

<  uu 
)  u 
>  -i 

r  — 

ir  it 
*s 

iNi  a 


CP  m 
O  U 


I/* 

rr  u 
at  u.  <K 

>  ^ 

<  ^  m> 

u.  -tf 
«^  IS.  fs» 

<\ 

»  or  a; 
•  #  • 

lA 

flL  O 
^  1^ 
—  O 
^  of 

»  ar 

«?  ^^  c> 
o  u 


M 

16! 


5  X 

Ul  U 
13  <  uJ 

•>»  ^  tt 

^  M*  U 

o         A  c  r 
«  ^  u 
»-  o 

o  c  r?  c  » 
:f  ^    <  X  < 

S  <         4  U  u# 

-•J        a.  '.I  X  -I  ^ 
ft  — ^irt-*** 

<  ^  ^  ^  ijL  f  t  ul 

OC  CL  C  ^  O*. 

•  ••••••• 

1^  ^     -J*  l«     •«*  •* 


im* 


^  3 


O  M 
<  Ik 

&  <a 

AT  « 
.2  ^ 

^  or  K 

*t  u 
«  <  ^ 

o  cr  wi 

|V  IT 

«r  ^ 

St  CD 

CL  a.  IT 
t  t  • 

O  O  1^ 

fv  f\. 
e  »  CM 


cr 


ar  or  c«  cr  « 
^  o 
^  .rt  IM>W 


u 
u 

<  ft* 

X 

Ml  S 

— 

y  ^  & 
>"  r 


9?  ^ 

^  mm  ^ 

It  2  « 

M  Pt 


U 


at 


2r  c&  ^  ^ 


•*!  <k  ar 
ft  or  «• 
>-  «  « 

I-  CI  a 

^  ^  ^ 

«««  ^  *4 
«  «  « 

fV  ^ 
•  •  • 

<n  i«l  «f 
4)  V  9 


3f 

l;  O 

—  JL 

a  X  « 
«Pi  ^  ^ 
t  •  • 

—  o  •> 

uu  ^  <0 

o  ^ 


'IE  <  O 
»  ^  ^ 
U  — 
C  4t 

Of 

^  # 


ll«  ^  M 
•  #  • 

•«  01  •! 


ERIC 


415 


IB 


or 


4r 


to  ^ 

C  V 

i«  ^ 


;r  'y      ct  ^  u 


<  — 


i*J  c  c 
^  ^ 


IT  » 
«  or 


u  - 


Si  y 


IS'  «c 


^  (V 

Ot  or 

r  o 


9C 

9C  fir  c 

04  C> 

«^  ^  4 

X  A.  1/1 

1^  1*^  1^. 
« 

ac  V  op 
ir  flu 
•  •  • 

fn 

fN#  at  ff' 
OO  U 

er  or « 
♦  ^ 


''^  ^ 
<  c 

a-  — 

^  «v 

a:  ^ 

o  o 

oe  or 

^  IT 


a 

U  4 

or  9C 
4-  *r 


UI 

> 

ac 

< 

If 


or  AT 


X 

M  ( 
^  ( 
U  < 

o  < 


C  5» 

OC  3 

r  or 

2  to 
<  < 

•  • 

G  o 
or  s 


u  ^  u 


uicr 
as  o 

iff 

•iOC 

&  c  < 


u 
ac  « 


O 


X 

u 


IM  CM 


O 

o 

c  c 
ft. 

IT  ^ 


o  o 


-i  C 
kL  — 

s  » 

•  • 

o  — 

^  o 

lA  «A 


u 

<t  ^ 

pr  < 

6.  ft. 

C  w 

'  «  X 

U  ^ 

>  s  ou 

I  O  CM 
»  (M 
I  •  • 
»  0^  p«t 

^»  t^ 

>  o  9 
or  or 

»  i/i  «/i 


7 


Si  c 

<  & 

X  r 

Qu  or 
•  • 

o  o 

or  or 

U>  lA 


lA 
<r 

Z 
< 

»✓> 

Ml 

or 


Ml 

z  or 
<  ^ 

>  > 

X  (A 

^ 
OB  S 

oe 


^  X  ' 
^  lu  : 

O  <  < 

X  U  I 

>*  o  < 

&  ft. 

O 


c  a 
ft. 

X  X 

Ob>  % 


U 

or 

u 
u 


a  IS 

OK  « 
X  M 


lA 


U       tA  mm 


Of  K  K 


lA  «A 


4  < 
«A  lA 


*A 


0^  or 

•  • 

DO 
lAiA 


or  « 

iy  o 
u  or 

Of  u 


^  X 

X  or 
X  < 

M  Ui 
3  (A 

•  • 

CM 

or  oc 


«A  W 

X 

-4  £ 

u 

ut « 
O  ft 
w>  « 

«ii  CP 

c  o 
«r  o 

«M  CM 

o  o 
<  < 

ar  or 


or 

lA  «A 

63  ^ 
O  OtA 


2f 

C  D 
Ui  or 

or 

s  u 

X 

«  lA 

Q  OB 


CM 
O  O 

or  or 


or  X 

u.  c 
£  Z 

<  or 
U  C 
X  44 
IT  <0 
«  *>« 
4>  Ob 
CM  O 

•  • 
lA  O 
CM 

o  o 

<  *A 

or  or 


u 

«A 

X 

<  c 

<  a: 

wm  m» 
«  « 

OC 

#  ♦ 

;>o 

lAlA 

or  oc 


^  X 

iU  u. 
or  «  £ 
u>  & 

^  lA  <  ^ 
W       «  lA 
^  O 

u  <  o  o 
oe  9^  c 

^  3  <  ^ 

er lAJ  u 
c  <  u  u 

£  2  C  fM 
«  «  «  4> 

M  ^  «««  fl« 

c  ofr  «*  oe^ 
oe  oo 
>  •  •  • 
o  ^  « 
•r  CM  CM 
o  o  o  o 

(A  CA  lA  M 

or «  or  or 


4A 

r 

X 

Ui  UI 

X  ar 
o  — 
oo 
•-ar 

A  III 


OC  or 


UI  jff 


or  UI  o 
«  X  ill 


C«  X  ftto 
iilO« 

»-oac 

Ml  w  I 
>Ofttf 

o»  «o» 

«i«Of^ 
•  •  • 

ooo 

oeoi  or 


ERIC 


416 


-••-«l^•^lf^i^«^l«l>l<^l(Vf^l<^il^l(^l^«f>«^ifVf^lf^lC^l<^«c^lfvr^r^|c^i^ 


4  . 


mm  «t 

*  • 

ft 

<  «  ^ 


r 

^  ft 


or  ML 

I.  * 
I. 

«  «:  u> 

fc.  ft 

-J^  — 

✓  « 

•p'  «c 

i»»  «  C  nr 

—  -J  L.' 
&  •  «»•  UJ 

••^  a 

—  c  <  ^ 
^  t*i  ^  «^  19 
W      u«  w  ST 

«  w  «  ^  « 

O  OD  C  0» 

•   ■  •  •  • 

^  M      ^  ^ 

D  v>  O  i»  a 

Ul       U*  IW  Mi 

«  «  ar  ar  df 


< 

;f  — 

<  o 

o  1.^  «r 
u#  X 
^  ^  u 

O  O  ^  »- 

*-  ipj  2^ 
^ 

>•  <        —  Qt 

ft  U  ft  M      «  U* 

U  —  I        i/>  Q 

ft»         4f  m  I*  iL 

^  ^  X  4  «  « 
ft  >  f  U  US 

u  V  c  u.  *  —  t: 

•4  ^  T      ^  >  U 

<  UJ  Uj       ✓>  «  » 

-< o  —  .^r  ft 


ft 

<    r  > 

—  « 
u  «  M 

—  ft  u  u 

^  ft  — 

X  —  ✓  « 

o<  z  u 

Ik  ft  V»  ft 
CJ  ^  W  w  »- 


r  o 
^  L><  s 
o     ft  or 

c  1^  ^ 
ft  D 

Ul  O  ft  Ul 
X  «  «^ 

V  iii 
IP  ll\  ^  ^ 

09  ft  ft 
1^  O 


l>4 


ft  «  ft  or 


«>  1^  Ui 

ft  ft 

ar  ft 

ft  4*  O 

^  ^  ^ 
««  ou  ecl 
(D  ft;}  e 

•  •  • 

^  «  a 
—  tr  <v 
o  —  o 
11/  t«r 
ft.  ar  ft 


U  L.  C 
—  ft 

II.-  ft  ^ 


^  ft.  <v 
U  C  a 
OC- 
ft  < 
IIMT  IT 

OD  ft  OB 

•  •  • 

u  —  — 
«  ft  « 
^ 


ft  ^  o 

^     ft  w  ^ 

ft  u.'  C 

Ui  >.  ^  « 

ite  7  <  ft 
5P  ft  ft*  U. 
—  -  C  ^ 

O      C  V»  t» 

«r  <  w  cs 
Mi  ^  ^  »i» 
»^       ^  ^ 

ft  ft  ft  ft  fti; 
«to  fV  <^  #^  <^ 
•   •   •   •  • 

U      IS  (M  U 

o  ^  O  r«*  ^ 
o  u  o  o  o 
or  ft  Cf  ft  ar 

^  ^  c  c  o 


ft 

Ui 
*» 
ft* 

u 
I  ft 

•  ft' 
I 


oe  X 
u 


a: 


X 

u 


<  IK  ne 


X 


^  ft  ft  u 


ft  « 


«v  «^  o  o 


u  — 

I4J  u  1 


-4  X 
ft 

o  «^ 

ft  — 

U  X 
u.  ft 
tp 

CP  « 
IM  IV 

o 


X 

3ft> 


ft  O 

^  ft 

IT 
IS  IS 


ftl  ft  41 
»        UIUI  ft 

ft     m,^  ^ 

Ui  ^  If  <  Jf 

o    <  o  u 

<  ft   ft  M 

<  ^ 

.7  ft      irt  » 


O  IS  O 
•    •  • 

IT  «<•  IV 


^ 

u«  i.j  or 
X  tti 
«A  O  > 
;»ft  c» 
ft  o« 

«l  ft  X 
«t  ^  ^ 

o  o  o 

#  *  • 

IV  IV  ^ 

^ 


»*»  ^ 

ft  ft 

ft 

car  ^ 
<  ftf  ft 

IMT  IT 
«  ft  « 


•  •  • 

^  ^ 

•o  m  ^ 


o 
u 
ft 

O  ft 
X  ^ 

<  «r 

ft  ft 

op  O 


ft 
4* 

ft 

< 
ft 
c 

ft  ^ 
ft 

ft  ft- 
c;  o< 
^  f. 
e  < 

O  «  ft 

U  ft  o 

c 

CD  CD  Oft 
lA  9  9 
O  CO 


ft  D 
U 

*-  < 

<  ft  ft 
ft  ui  »<- 

a  ^  v» 
u  s 

UI 

u  >  ^ 


Ui 

set  oc 

O  Oil 
2S 
mo 
tti 

U  </> 


ft 

Ul 


O 


Ui 

ft 


4k;  < 


U  ft  ft 
«  o 
I  s  — 

IT  ft 
O  ^  Ui 
^  «A  ^ 
U  Ui 

^  o 

P« 

^  «  IT 

ooo 


ft 

«M  Ml 

ft-  X 

ft  itt 

u  u. 

Oft  mm 
CD  CD 
OO 


ft 

^  ft 

ft  M 


C»  ft 


ft 

u.  o  < 
—  ^  « 

ft  w*  c 
ft  ft  o 

^  C#  Ui 
U.  ^  C 
^  ^  ^ 


ft  81  «  OD 
O  O  O  O 
•  •••••••••• 

(VO<«OlVIVIV<*«IVIVfV(V« 


<0 

IV  fs 


►  tA  I/I 

4i  < 


X  — 

u  ft- 

or  ftc 

mm 

ft  » 

CftO 
•  • 

o  ^ 
o  — 
ft  ft 


ft  ft 
Ui  O 
X  u 
ft  X 
«  to 
ft  — 

c  o 

Z  X 

ft  ft. 

MfV 
^  Oft 

or 

•  • 

ft  ff 


u 

ft  >  « 
m  ft  u» 

XUi 
U  l/> 

I  ^  > 

U  W  G 


«s 

M^M^ISfVfVIVIS^f^ 


III  at 
at  i» 

I* 

or  UJM 
3a:  w 

«  ft  i-» 

ft  UI      ttl  ^ 

e  ft  ft  9 

ft  «i  UI  UI 
ft  ft*  0 

OUJlIb**^ 

«  ift 
o  « i(»  do 

IV  M  O 
•  •  •  •  • 

O  «•  Ml  Ml  «i« 

uuuuu 

MB       ffis  0^       9^  CM  M  0mt  m 
e  0^(V^«ll^«^ftO'0««M^<irftA«^ft)»0«iftl^«<% 
MfSfMrVfSMMMfVIVIVISIVMfVCVtVfVIVfUCVfV^^M 


lAI/ftMltAlA«AlAUlUlUimUI**"M«*tolP«l*i»«««MMMMMfti»Mft«MMM«ii« 


ft  u  ^ 
U  CI 

X 

ft  ^ 
<  ft  ^ 

ft  U  <A 

to  sr 
C  U  UI 

^  UI  & 

p  ft  ^ 

X  toO 

ft.  o  u 
in  ^  ft 

•*  *  Oft 

ft  «M  p« 

(V.«  «p« 

•  •  • 

M  UN  €^ 

^  a* 
or  o  o 


ERLC 


417 


I  «  <ii  «i  4»  fM  < 


u  > 


C 

>  It 


• 

• 

T 

if 

X 


*  "  >  a:  X  ^ 

m:  ^  X 

^  u.  w  o  1^*  < 
^  1^  ^  «/» 

»      C  ^  i- 

<  &  V  1^  ^  « 
a.  u  «  ^ 

«^  w     e.  X  cr 


u* 


M' 


< 


UJ  M 

a:  ui 


3 


ft. 

u 

^  X  1^ 

«^  «•  ^      «  U  ^ 


u 


1? 


1^  X 

C* 

u  « 
X  ii. 

1^  ^ 

X  X 

41  4> 


4. 

^  ^ 

C  &  ar 

r  D  c 

M  ft»  tl» 

if  — 

-4  X  X 

IT  iT 

flD  (T  gp 


>  ^  X  ^ 

W  ^  m*  T 

;S  U  ^ 
3 
w  9t 

»  ^  ^  pr 

c  c  w 
X  U  U» 

^  kl^ 
V         £  X 
O 


a:  or  ui 
u  ai  w 

dt  9i  «■ 

c:  <  > 

U  K  or 
Ui  »  ui  «/> 
X 

^  <  X 
C  «k  c  ^ 
'J  X  w 
«  <• 

...  VI  >  Z 

^  V*  M 

Ui  .T  ^ 

or  U 
U  «/>  flC 
U  X  K  S 

«  £  a 

X       1^  1^ 

X  «  ok:  « 
^  —  ^  — 


e 
m 

14.  lU 


or 
u 

X  c 
•I  ^ 

^  vr 

»  OB 


C 

o 

X  A. 

Ui 

«■  « 

u 
&  o 

u 

&  u> 
X  U  ^ 

>  u. 

« 

<  liJ  < 

or 

X  ^ 
«7  ne  Li 

u  -  >C 

c  o 
L.  ar  ^ 
.It  O  »» 
^  %t  ^ 
X  X  o 

•6  «^  ^ 


o 


u 

O  IT  X 

«  u 

y  w 

X  c  u 

UI  M 

c  «^  ^ 

<  Z  U« 
C  i.:  W 
tM^  X 

<  >t  ^ 

r  UJ  < 

<^  iT 

QB  cr  a 
^•  fv  M 


Ui 

X 

UK 
X 

OJ  IL* 

o 

2e  Ui 

S 

U  u* 
S»  X 
o  «> 

•i  it 
«f  ^ 
u> 

C 

>•  «i 

X  3 

a  X 

tl>  IT 

a>  o 


s 


•A 

X 
Ui 
X 


g 


z 


or  <i 
^  2* 

X  3 

ft. 
^  D 

X  c 
X  a< 

1^  4M 


^  Iff 

as  X 

<  U. 
^  D  U 
X  ^  X 
^      u*  U.  ft. 
X 

terf  IM  «  K  Uu' 

<sr  K  c  <  c 

X  U.  U.  UI 

a  «i     O  w 
>  X  3  OS  «J 
U        <  u 
<  X  »  u 

^  «««  K\  c 
Si  flO  flU  Xi  fl> 
rv  ^  M 


X 
3 


X 

v>ai^  4  X 

u.  ^  X  Ir 
«iU«-  C  O  X 

<  ^       X  :j 

W     O  ^      il  <^ 

Ui  4 

c  U 
X  c 

X  «/t 
CD  X 


u 
u 

X 

u 

X 


X  X 

ou 
uu 

Ui  U< 
X.  X 

ti)  ^ 
^  u 


ui  K  <  O 


X  lA 

<6  ^  4^  I 

a»    X I 


x  c 

>o  X 

X  Ui 
*J»  X 

g»  OB 
00 


X  :p  • 

IM  «  ( 

XI  u  • 
A  X  I 

IT  t^ 

00  X  I 


U  X 

•J  H- 
d»  U 

P  Oi 

X  a 

I/I 

X  ^ 

UI  C 
X  K 
^  no 

X  i.^ 

^  QD 
X 


X 

o 
xu 

IM  Ui 

O  X 
X  «A 
U. 

X 

Ui  X 

X  u 

«A  o 
sr 


X  X 

Ui  e 

UI  X 


s 

M 


u 

Ui 

X 

<  u 

M  «i> 


X 

ui»»  —  X  X  X  2u 
«/aiu«A  »**Xi*iX«iUi 


10 

X  w  ^ 

II.*  4b  « 
U 


at 


o 
a  3UI 


□ 

X  o 
u  u 

VI  a. 

X  ^ 


W«t««^XlAiuKMXUlXMil(^^ 

CwplAXUdllAMlUIUI 
XUI^ttlX3XSUI 


X  X  fV  Q      C$  9m  mm  m  mm  9m  ^  0m  9m  ^      rm  mm  mm  m  mm 


X 

lis  M\ 
90 


ou 

X 


X  X 


X  X 


11^  IAIf% 


CD  X  QD      X      ^  9  iB 

00^  ^ 


«     *M  o  — 

X 

M>  l»  fS. 

<J»  .  W>  U  X 
^  UI  M  UJ  i*l  Ui 
III  til  fc^  Ml 

#^  ^  »  9 
4»  <x  «  « 
^  fV  fU  IV 


X  «  —      —  — 


1^  cc  ^  i«     ^  ^    r»     #     «  <o  :^  ^  ^     ^  »  <*i  ^  <^  O  <^    «r     tf^  1^    <x  «  ^  x  a» «    •rttfl|^lA9C^     <o  mmtmm 
9  a:  X  X  a*  X  c»  CD  »  u tf^  o  ^  ^»  i^  tniA  ifi  «^  ii>    ii>  ^  l^  l^  «r  i«i  «i  ^  «  4>    4»    (^«^(^«^k^  991^ 

o -4  M  Ml  f\i  9    o  9 o  o       ««i  o  o    o  o  M    o       o    M  o       o«>*<^oo    o  000 

44UjUiUiUIUiUiulUulUjaitoi«UiaiUi4iUiM*Uiai04444<<<4Ui«UiU^UfUiUUUUUUOXXnCUIUll^ 


UIU'UiUiWWUiUiUiUi-*UUOU>UWU>MUUUXXXXXXXXXX*»^*»***«»**"*"*"***-**^**^****«t****""^****<^* 

^i/ii^%^t^vii/iv^ii>vi«A^wo«/'.  i^«^(/^«o«^^^^«/>i^yi«A^«A«Ai^^Mii/)«oiii(/>M 

0^fV«^^ili^«^XX0<i«r>>^«V^^N»X9'  O.-^  iMi^i#ir^^X9'O^I^^«tf^<C^X^e*^<Ml^HriA«O^X  9'O««m«^«rtf^<0KX^ 
f«»lu^fuK»|»KK^»kXXXXXXXXXX0'>^(^^<^<^»^^UO9OOOOOeO«i•M•^•rtP««i«^p••-««rtM^M^M^MMMM 


ERIC 


41 B 


tf0 


tfS  0%  ^%  1^  ^  0i 


X 


U  4."  — 
U 

•    .4  W  > 

on*?* 

W  ^  « 

^  *  ^ 


fir 


CV  ff 

•  •  •  • 


or  < 

1%  i«» 


u  X 


It  4d  X 
^  —  O 

or  u  u 
&  ^>  u. 
^  a 
^  ^ 
IT  ^^ 
&  tt  OD 
«  rvi  O 
<M  r>» 
•  •  • 

%j  ^  ^ 


^  ✓  — 

«r     i»  ^ 

re  ^ 
%^  c 
»/.  > 
r  u  < 

^  w  «/> 

<  <  ^  r 
*t 

^     u  ar 

U.  Ml  < 

^  :^  y. 

^  if  #  4; 

oc  a  «u  a 

^  *  X 

-^  O 

•   •  a  • 

(9»  9  ^  U 

^  ^  ^  11% 


«  «  «  « 

«A 


1^  « 


4  4  < 

i/l  ^  i/l 


<t  «  «t  u 

^ 

O       fV  ^ 

^  ^  ^  «r 

t0^m 


U.  < 
cr  ^  urf 

^  !■» 

}^  ^  < 
J  U 

au  ;^ 
M  2  ^ 

<  «A  < 

or  «r  terf 
—  a 

tf>  «n 
OC  » 

«  ft) 
^  <\. 

»   •   •  • 

►  M  :^ 
I  Hi  *  •  «^ 

»  «A 

I       O  W 
I  W 
tf^  ^  1^ 

«r  «  ^ 


1^ 

e  ^ 

<  « 

IT  *i 
itf  u.  M 
w  U 

<  I/)  ^» 


91  Urf 


^  mm  Cf 
yi  mm 


>-  <  a 

P  u>  =^ 

c  ^« 

^  %f  ^ 

c0  X  00 

IT  «^ 


^  c 

o 
•«^.  c 
ac 

^  or 
«c  to 

IT  lA 


<  #• 

9 


fw  o  ^ 
^  l««  ^ 

'V 

lA  «/l 

^  ^  w» 
oc  :^  o 
^  ^  1^ 

«v«  1^  m 


«  — 
or 
i>»  ^ 
^  1^ 

z  ^ 

AC  O 

r 
CO  or 

IT  flt 

*^  ♦ 
IT  1^ 


a: 
u 

2 


«  C 

sr  or 


fit  «  fit 


9 

a  ar 

s  a  « 

ft.  ar  »^ 
«  I**  a*  ^ 

vj  *^  4^  ^ 

•«  «  u  < 
X  *  ^  ^ 

•  ^ 
tl  \c  ^ 

> 

<  &  qe  ^  M 

lu      ui  C 

1^  .ijt  e  ft. 

C:  ^  «9  «  C 
o.     ^  at  ^ 

^  1^  ^  IT 

«e  eD  A  c  s 

«  if\  ^  ^ 

^  1^  •* 

•  •  •  •  • 

&  CM  *i«  tf« 
*i«  <^       •«  lirt 

OV*  «  u 
or    <  ^  «^ 

Ui  ^  Ui  a«i  iu 
a  ^  o  —  iv 
tfMA  <P  <P 

^ 


flC.  AT 


UI  UI  UIIM  «Uli# 
O      ^  ^  ^  lf% 

e  9  9" 

01^  #^ 


ERIC 


419 


»  C 
^  <  W 

<  «  « 
^  a 

^  it. 

^  z 
^ 


Krt  fit 


^  ^  C 
X  «  « 

A' 


»  ^  <^ 


9  O 


or  (P 


OO 


ft  >  ^  ^ 


fir 

144 


IT 


OO 


•J*  *rt 

^  «r 

or  »  or. 

^  gi.  iiH 


Pt  ^ 
<  — 


<v»  ^  id  ^  ^ 


r 

a 

u 

nc  *^  ^ 
'J>  ^  ^ 
^  —  X 

<  r  L> 
er  u  < 

<  & 

a,  > 

i  ^  ^ 

o  — 

**f 

;j  <  o 

I  .-V  ^  « 

I  >>  a  a 
1 1^  «  ^ 

>  <^  <^  <^ 

^  fV  IN« 
«  flD 

^>  ^»  ^ 


<^  1^  (i» 
lA  flu  » 
^  M  M 
<  <  < 
«A  lA  UI 
Urf  Ui  Ui 
IT  ^9  ^ 
Q  O  O 
^  #  # 


or 
^  u 

O  Z 
^  4 


oe  or  Of 
I.'  u  u 

fM  ^ 


<  ft  u 

U  Ik  u 
ui  ^  ^ 

u. « 

<  Z 

X  a 

U 

<  i  :i 
fit  C  Z  IL. 

& 

^  «^ 

U«  ^  Ul 

^  ^  1^ 

^  oe  ft. 

^  ^  mm 

0      •  • 

mm  O 

1^  Ui  M  «A 

«  (T  at 
u  u  u  u 
ii\  4»  ^  a: 


or 

c  or 
»-  u 
<  ^  c 
« 

a-  -J  s 
c  a 
t - 

e# 

IM   ^    ^  ^ 

X  a 
>-  u  s 

«  U  Itf 
4  IL  <  C 

a  U 

^ 

u  ^  —  « 

ev  C 

»-  tf'  -ul  K 
^  a. 

^  c  y  M 
a     c  ^ 

•M  ^  1^ 
^   <      C  ^ 

'T  <t  ^ 
9  or  «  9t 

Of  r  « CD 

M  4^  m  IT 


o  «  « 

^  IM  U 


X 

u 


of  u 

UJ 

o 

u 

»  lil  M 

«  ^ 

vii  M  %A 
«f  Z 
U  O  »^ 

«^ 

<  O  V 

cr  ^  o 


Ck  o  u 


S       <  I4i  ML  X  U 


*  ^  a 

O  «4  «r  «^  ife 
—  ^  ^  I  u» 
a;  U  C  Z 
flc  ^  W  ITix. 
C  <  UlwW 

u  <  X  r 

oc  «  fit  'S* 
ff»  OP  «  flC 
C  ^  *  I'' 


K  ul  CV 


U9 


e  <M^i 
%^  (/)  UI  «A 

o  o  o  o 
^  ^  ^  ^ 


<M  «\i  rM  <^ 

UI  4/1  UI  U>  ui 

^  ^  IT  4>  ^ 

«V  fS»  «V 

*  ^  #  ^  ^ 


cr  O 
>  o 
<  or 
&  a 

«i  or 

«  flC 
(1%  9^ 

UI  m 


o  « 

cr  a.* 

Ci  — 
(V  f\i 


•«  U-  A. 

Z  u  o 
o 

^  z 
i;  a  UI 

<  UI 


^  9»  O 
^  IV  ^ 
^  ^  ^  « 


1^  ui  1^ 

c  ^  z 

I**  ir 

OD  »  C 

or  s» 

i#  ITN  ISi 

•  •  • 

^  fV%  «« 

^  O  O 
fV  IV  O 

or  OC  Mu 

M  M  UI 

uuu 

<\«  0^  ^ 


u> 

U  Ui 

ar 

^  Qt 
D  UI 


a  UI 

c  «r 
«  oc 

•  • 

lA  ^ 
UO 

(V  rv 

UI  UI 
M  UI 

u  u 


OR 

a# 

H-  Ui 
«  O  CX 
«  1*1 

•f    a  UI  u 

.J  UI  u  ^  UI 

«       t?  X  « 

a  Z  a.  <ii>*  U  *JJ 
U  «4  O  *ii 


or  a 


or 


^  ^  ^  « 


>  u* 
«u 

OP  Ui 

N»  Of 

X  or 

<W  UJ 
MU« 

uu 


i-i  u 


ut 

«JI  u> 
uim 
i»  ^ 
^  if 

(V  9 

IV  0» 

UlflT 
Ut  UI 


oc  u 

cr 


UI  UI 

u  u 


or  «  or 
«  < 

tm  ^  ^ 

Ul«f»lk 

Of  -  u. 
ut  < 
«  OJ  u> 
^  UI  «  u« 

« 

^  ><•  u 

oi  *r  «  flt  0^ 
U»  O  <  '3 

Xof 

UI  U  41  -il 
«  UI  UI  M  IM 

flt  «  a#  4»  CO 

«6  <A  ^  «  41 
^  |r      1^  («> 

•  •   •   •  • 

<■<  ^  (^ 
»  v»  4  4 
fv  tv  fv  «v 


u> 

UI 

UI  K 

or  -I 
a  u 

4  -I 


0; 

IV 
fV 


^  IV  ^ 


UI  UI  UI  U)  u> 

uuuu 

«  4  ^  4  4 
^  ^  #  4  ^ 


oc  or 

UIUI 

uu 


or 
at  u 

&  u» 

UI  «J 

uz 

«  UI 

X  r. 

u. 

lA  ^ 

flO  A 
09  « 

CIM 


o  c 

U  UI 

u  or 
<  u 

tf^  IT 
X  V 

or  « 


UI 

I 

oe 

u 

4e 


o 


u 

•>u 

IM 
UlOt 

a  UI 


UI 

«  I 

or  or 

UI  UI 


UI 

i 

u« 

g 

m  OK 

Ul 

»  o 

UI  ^ 

oe «  ae 


Ui  OU  OM 


€9  O 


Uf  Oi  JU  UC  UI  UI 

uuyu 

"  ^  fV 


o 

tfi  ii\  ir^ 
4  4  <  4 


u 

-I 

 Z  OC 

UU  «  &  d 

^  #1^  #  ^ 
CD  S  flC  ^  « 

r  90  4r  copto 
r%  ^  ^  9 
•  •  •  •  • 
««i  Ol^ 
M\ 

Ui  •*«  4 

or  ui#» 
UI  or  UI 

^  f>»  flE' 
UI  iMA 
#  ^  ^ 


9  ^ 

u  w 


OH 
or »  o 

«««  • 

•  •  • 

Mtciin 


lA  ^ 
4  4 


S3S 

4  #  ♦ 


erIc 


420 


• 

^ 


or 

w.  •» 

«  — 
•»  ft 

or  :j  ^ 


^ 


<  ^ 

^  ir  rf' 

•::  -  c 


^  «f  < 
^  u« 
« •«  c 

>•  «  ^ 

w  T  CL  •<» 

*  «  ^ 

a  U  C»  < 
Z  ^  ^  X 

>.  ^ 

^  J*  ^  ^ 

«  lO  a  ic 


ft  y 

o 

CI  u 


Ik 
OP  y 
•I 

^  -5 


X 


if  M 


^  «^  U 


3»  B  9 


ft.  w 

ft  ft 

C 


or  u 
U  ^  a. 


^  ft 


•I  «  « 

«  «  ^ 


X  4^  ' 

««f  O  «A  lA 

W      —  I 

^  or 
c  «  «  ^ 
« «t  #  # 


^  X 

•A  M 


V>  O  tf^ 


c^  *i*  I 

IT  ^  * 


•r  o  M  ^ 
^    ^  ^  1^ 

^    ^  «  «t 


»  X 

X  9: 
fp  <  U 
or 

u  O  < 
—  U  y 

^  i»  40 

^  X  :2 
1^  *r 

a>  «M 
X  C 

r  »^ 

•   ft  • 

<V  <^  "O 

«^  ar  0,1 

^  ^  n 

«^  «^ 
^  ^  ^ 


ifc 

^  — 

^  rff 

rr  — 
✓  r  & 
<  «^ 
*  t-^ 

a 

c  o 
<M  oc  ac 
X  « 

•  •  • 

o  1^  ^ 

1^ 

^  N  — 

O  ^  UJ 
u/  O 
flr  •! 
«M  ^  C> 
^  ^  X 

^  ^  ^ 


> 

•J  u 


-  X 

X  X 
«  • 


or 

^  %^ 

^  Si  ^ 

w  ^  W 
c  < 

^  «s 

or 

w  —  u 

W  »/>  M» 

^  >»  «A 

w  X 
n  X  X 
*r  rf*  ir 

—  X  cc 
ft  «\» 

«  •  • 

M 


oe 
tti 


ac 

u  ae 

ot  X 
X  u.  u  u 
X  4  «  o 

W 

*^  «f  u 

o  X  ae 
c  <  ;>u« 
<    £r  ^  ^  ar 

#<••  |M>  W  ^ 

u  — 

^  OC 

<  fir  ^ 

&.  4  U  ^ 

^  C  %e\^ 
9  » 

«V  1^  X  X 

coos 

•    •   •  • 


»  ft 

ir^  IS 
ae  X 

•  • 


«  ^  iT 


<  Ui  *A 

or  « 

«/i  <  ^  « 

^     ^  <  tt^ 

C9  X  X  ;u  X 

^  <  ^  ♦  * 


1/)  lA  W>  «/l  M  M 

<  <«  41  4t  «  ^ 

^  ^  CO       U  ^ 

X  X  ai*!x  c  ^ 
^  ^  ^  ^  <  ^ 


oe 
ot  u 

<  oe 
or  K 

X  UJ  ^ 

u  a  ^ 

<  M  I 

U  Of  I 

X  r 

<  lA 
or  1^  < 

C  «fe 
iT^  tf^  <^ 

CD  M  M 

fSf  ir^  X 

QUO 

•  •  • 

^  ^  iT 

Hi  lA  4/1 

«A  M  M 

<  <  « 

IV  ^  # 
»  r  ^ 
^  «  # 


U4     <  X  < 

^  oe  X  ot 


s  c  o  X 
u  u  - 
oe  u 
<r  w 
<o  fv 

C»  X* 
•  • 

^  o 
o  # 

nr 

4  or 


!•»  or 
ts  X 
IV 


<r  «  « 

lA  lA  hA 

or  or  a 
X  ^  w 

»  r  o 
tr  tf^ 


oe 

S  X 
tti  o 

a.  ^  ;if 
u  «  <t 
oe  IL 

OOt  ft 
O  ft 

«  «  r 
«  <  w 

w  ;? 
^  ^  ^ 

<^  fi*  X 
OD  « 
X  — 
•  •  • 

^  ^  ^ 

Ui  Uil  u 


oe 


X  oe  or 
fv  *^ 
o  o 
11^  11^ 


goo 


X  or 

^  o 
•t  < 

oe  r  tr 

«w  X 
•»  X  U 

^  or  oe 
«  «  u 
^  w  w 
^  ^  ^ 

M  SP 

«b  41  a» 

•  *  • 

« <r  u 

i#  #  o 

«A  M  V> 
lAI  OK  M 

oe  o*  X 
#  ^  « 
e  oe 


X 

a  X 
<  > 

•^oe 

14.  %A 

in  tf« 

09  00 

^  oe 
^  — 

^  Q 
%/%  mm 

III  o 

3 

oe 


CO 


m  X. 

o    or  lA 

a  .1  ^ 

^  U«  O 

^  « 


X 
Ui 


—  u. 

X 

oe  or 

X  u 
e  # 


# 

«^  X 

«l  lA 


It  4#       M  ^ 


00  oe  e  A  or  OP 


—     Q  O 
•  •  •  • 
^  ^  C*  ^ 
1^  ^««fV 

o  o 

M  lA  « 

oe 

S  «  oe 

O  ^  «^  <M 

IT  lAiA  in 


•  • 

o  X*  < 
oe  oi 


lA 

2| 

uor 

<^  IV 
X  Ol 

141  u 

M  AM 

or  oe 


-  ^  <  ^ 

X  X  t4>««  < 


or  lA 
X  u 

^  X 


X 

10 

^  3 
^  X  U 
«C  O  IX 
M  IV  fV 
^»  OD 
OP  ot 
oer  00 
•  •  • 


X  r 


in  1^  in      m  IT  1^ 


O  lA  lAi 

or  X  nr 
u  «M 
IM  M  <M 

IT  m  11^ 


o 

ieoB 

MO 


-41 

«l  «A 

oe  «A  M 
c  u  iw  oe 

X  III      ^  % 

niiv  iv^M 

00  V^NOP 

^  «  <c  e^ 
oe  «  «  e  Oft 
•  •  •  •  • 

9  0%  <^  iii 

M      IM  III  ^ 

<VfV 

mm  m lA  if% 


421 


ERIC 


BEST  COPT 


X 


2r 

X 

u 


a  . « 


or 


•t 


% 

&  * 

••5  U  ^ 
U.  I»  •  ^ 

«  &  9*  ^ 

«  U<  w 

-«      ^  & 

«^  ^  1^  «% 

CD  r  ^  ^ 

•  •  •  • 

^  «r  9 
^  ■  ^ 
^ 

•»  V* 
W      •  fl^ 

A  w 
IS  ^ 


> 

u.  ^ 

«  s 
r  an 
•  * 


^  -J 
C  — 

i;  < 


OP  9 


or 
It 

>  >  X  ^ 
•»  <  C*  U. 

»  d  ?  o 

Mi  c 

>  ^  <i  «  « 


4^ 


V  w 


^  »  a 
«  a  ^ 


«  SB 


^      IT  > 


or  ^ 


m  ^  fV  V 
^«  •*  4 « 
^  ^  M 

O  Ui 

qr  or  it^ 
a  o  — 
m  ^  ^  ^ 

lA  «A 


c 

T 


u 


u  or 

^  « 

r  c 

u  s 

o  < 

r 

—  o  • 

<  ^  or 

*.  C  <  i-j 

St  or 

U  —  U 

u  <  w  « 
-i  a.  u 

*  ^  ^  ^ 

Of  ^ 

01  ^  &  ^ 


u  <  ^ 


cr  4>  ar  ^ 

^  «^  u 
or  M  VI 
^  dD  <r  Q 
%r  4^  ^  lA 


oe 

Ul 

or 

u 

O 

OC 

ft 

& 

or 

3r 

Ui 

Q 

«A 

r 

m 

ar 

Ul 

»i 

«s 

^  oe 

w 

m 

U 

tj 

w 

a 

< 

a 

u 

40 

ft 

^  M  U 

o 

o 

Ul 

mmmm  ^ 

%  *A 

U  — 

u/ 

m 

40  N- 

or 

M 

U  OC 

X  CL 

U 

« 

c  «  o  o 

Ui 

u 

OC 

•-a 

m 

•%x 

%f%  4A 

«  OC  « 

OC 

V< 

ac  <j 

w  ft* 

> 

J»U     ft  u 

c 

iU  u. 

u.  < 

CI  III  III 

«#     *^  ^ 

or 

Of  k 

y  '3  U  »^  C  u» 

O  OC 

X 

O  X 

*» 

u 

or  X  4 

Y  c:  X  <^  lA 

X  » 

>  «A 

^  <  j[f  Ul  u  ae 

1/1 

X  w 

lA 

u 

1^    ^          P  M»  « 

^ 

< 

<  iAt» 

u^.      «  o      U  M 

#  M 

z  ^  ^ 

o 

m 

# 

m 

&    C  ^ 

*  *i  ip; 

CC  ^        c  c 

X  ui  ft 

u.  v> 

< 

X 

o 

u.       ^       >  ^ 

or 

•»  ^ 

Y  <     or  «  X 

b 

C  >  V 

U  - 

u;  or 

m 

g 

X  « 

u  ^  «  w*  «^ 

i*i 

uu  w 

r  r  u 

-i  —  ^ 

ft 

ft  « 

^H>UftOCCM  » 

w.  <  U  ^  tA  < 

IL 

Ou  X 

»  ft  ft 

io  «•  r  c  « 

lii  ^ 

X 

? 

u 

o 

o«/>ft»>>uiO<a( 

&  —  «^  A. 

r 

^  C 

«4  <  c 

t  X      ft  u*  Of 

X 

lA  ^  ft 

^  t 

u 

ft  X 

ft 

u 

X 

UM|j0oCftftlll 

o^uixouor> 

^     n  n 

i» 

y  Oi 

C  or  or 

C  II*      U*  ft  X  U. 

/UP 

u  ^ 

lb  O 

p  «j  ^  «/> 

M  |£  ^ 

«"    er  ^  ft  ft  ^ 

< 

;^  ui  u 

X 

.1  fr  C 

u. 

>  « 

•» 

X  ar  or  Ul 

031 «  Ji 

c-  u  X  c  «  l: 
X  c>     U  X  ft 

^ 

c  < 

3  X 

ft  Ul  u;  K  c  c  3 

mi 

K  « 

V 

P  «  CI 
ft  ft  X 

ft 

< 

X 

S  >  u>     O  O  lu 

O  i.  O 

^ 

mm 

ft 

ft 

ft 

ft 

«  e  ^  «^  %r  ^ 

IT      IT  m  tMT  m 

m 

^  m  m 

ir 

m  IT  ir 

m 

m  m 

<P  «  9  «o 

iM<r  «««o 

C  0P«« 

^  Of  9»  «•»  P>*  OP 

Of 

«  X  V 

A  QB  CBr  M  QD  QO  9 

(t 

»  OC  « 

9 

X 

0^ 

00 

or 

9 

«  X  o  • 

^  ^  ^  ^  f»  ^ 

oo  <«m  «-o  o 

o  ^  o 

o 

o  o 

o 

o 

o 

o 

CB 

M         «^  IM  IS  «i« 

•1«  p» 

^  <i*  ^  O 

9 

•  ••••• 

« 

#  • 

•    •  • 

•  •••••• 

• 

•  •  • 

• 

•  • 

• 

• 

• 

• 

• 

• 

• 

•  •  •  • 

t   •  • 

M  ;^  (^  fM  M  ^ 

«H  » (^ 

^  M  ^  ^  >  ir«  ^ 

mm 

m  ^»  m 

m 

o 

m 

u    m  u 

^  ^  ^  M  |t« 

fte  ^      ^  ^  ^  9 

^  oiir 

4^  ^ 

tmfm^f^ 

^  o  o  ^  - 

ISO 

n# 

o 

O 

Q 

o 

o 

O 

1^  Ui  OC  u  uu 

u 

<  X 

or  v^uiiAuuu 

or 

<  IM  «v 

uu  « 

uu 

m 

or 

4f 

muiu«» 

uj  lu  «/i  m 

ae  «    «  «  oe 

1/1  ^  ^ 

*/i  or    M  lAi  uj  ui 

Ui 

Ui  o  ^ 

««« 

« 

« 

m 

m 

K  OC  UK 

^  ^  i/>  ^  ^  lAi 

IM  O 

—          y»  i/» 

m 

mm  m 

m 

*A 

lA  «^ 

wo 

Ul  U> 

•«*»^m 

e^it\  ^  ^  ^ 

a»  ^ 

m  ^    «  » 

o 

^  fV 

m  « 

X 

»  a 

m» 

n« 

•M 

m 

«^  « 

tr  IT  l^  i^^ir  4^ 

tf^  in 

^  «  ^ 

^  ^  ^  c  <o  ^>  « 

1^ 

^ 

«^ 

K  00 

m 

» 

09 

9(OQ0Q09lr^9 

11%  in  in  11^  iMi% 

IT 

«f>  in 

mm  m m mm m 

m 

mm  m 

m 

m  m  m 

m 

m  m 

m 

m 

m 

m 

m 

mmmmmmmm 

422 


& 


X 


=  r  = 

U      W  9  u 


V 

V  *• 


if  « 
^  •i*  i«* 
1^ 

;  •£ 


u  ^ 
—  fc.     «  u 

<  ^  ,r  e 


^  * 
•  •  • 


m 


^  •«*  u 

fr  < 
^  a 

.  4f  ft 

V  flt  It 

^  ^  ^ 
•  •  » 


CP 

ar 

^  m  ^ 


*'  u  ft 

i  •  ■> 

0*  w^  IT 

T  V»  « 

•  •  • 

IV  «^ 

«p 

s>  ^ 


4.* 

s 

^  u 

mi  « 
X  u. 

W  U'  «^ 

u  ^ 
*t  ^ 

^  « 
^  ^ 

•S  ie  mm 

u  «  ^ 
iC  1^  i/% 
9  OC  T 

i\#  rs* 

O  Q  IV 
t  •  • 

,r  «p 


cr  X 
X  -1 

•s  ^ 
I.  < 

ft  » 

M  !■»  »» 

;p  — — 
^  X  X 

tt  ^  tf> 
«.  <c  cc 

f\.  CD  IV 

•  •  # 

1^  IV  ^ 
ii%  tf« 

o  o 


z  -r 

<  at  or  X 
u*  c 
^  X  X  *t 
U  U 

i<  «  «  ^ 

u  u 

IHB  M> 

I-  1^ 

2  <  1^  <  ft 
W  W  CI  U  J»  Ui 

5         •  r 

U  U  Ui  k  U 
w  •*  —  t>  < 

^  ta* 

—  «     u  r 

U  ^  ii^  C  X 


X 

u 

or  « 

X  ^ 
u 

M  ^ 

or  «• 

ui  ;p  u 
X  u  oc 

U  tol 
4  ^ 


or  a 


%A  «A  lA 
<  <  <9 
V  — 

O  iO 


l/l  lA  «^  «0l  W 
«  «  «       %^  l/> 

^  «r  «  ^  X 
oouo 
^  «o  «o  «  ^  « 


X  >• 


^  X 
•r  ir 
s>  er 
iv 


fV 


or 

or 
u  It 
l« 

1^  IT 

fv 

IV 


u  or 


c  _ 

^  fcft  u 
<    «r*  Of 
;r  o  u 
u  ^  •# 

c  «A  M 
&  1^  X 

£  a.  1^ 

IT  iT^  «  ^ 

00  &  oe  «^ 
^i  ^  ^i  #f« 

IV  IV  IV  c 

•  •  •  • 

«r  u  <v 

«r  IP  ;r 

u  d  o 


LJ 
L. 

or 


«  41 

or  uin 

^  «      ^  ^  X 

U  lA  feL 


X     a>  *^ 


4t  «  <  M 

«A  ftA  lA  O  4  < 

(T  i<»  ^  oe  ^  U 


^   «f  4A 

W  < 

Oit.  oir  r 

U#  U«  41  « 

^  X  »  urf 
^  ^  so  > 

u  <  ^  u 

U  4.  W  o 
W9  ^  1^  « 

o;     00  cc 
^  IV  <o  fV 
IV  fv  rv 
•  •  •  • 

^     w  tp 

3  O  —  O 

<  or 

Oy  fV  N  M 
^  «  <o  « 


> 

Ok 

<  ^ 

or  ^ 

0?  m 

M  1^ 
m*  fV 

or  41 

IT  « 
IV  IV 


^  > 
c: 
o  < 

IT 

OK  90 
•  • 
O  — 
«A  < 


t"?  <  ac 
;f  ^  «^ 

u«  K 

ar 

Ml  ee 

ac  ^ 
ii>  ^  ^ 
>  »  « 

<  ft^ 
lA  ir 

X»  OCr  « 

«o 

^  M  — 
•  •  • 


IA#  lU  U 
41  <  M» 

o  •* 

^  #N  M 

«  «0  « 


oe  u 

or  r 
X 

U  ^ 
X  m 
<k 

ot  «A 

;r  41 

l^  lA 
or  9 


oe  <  « 
Ik-  nr 
C  :9  lA 

<  41 

^  lA 

<  lA  lA 
^  Ul  « 


O  ^ 

<  ae 

«t  Lui 
Ik  0( 


or 
« 
or  o 

C 


It 
<  lA 

X 


>  w  s  ^ 


41  0> 
MIV 

lA 

Ul  lii 


U  <^  ui 

or  ^ 

e:  -«a  Q 
« 

1^  «  or 
2  «  w 
—  ft  a 

l^  IT  lA 

<D  s»  9 

^  -i* 
•  #  • 

<4»  1^  « 
fl>  00  <M 

^  SI*  «l«  « 

%A|A  ( 
Ui  U*  IM 

IT  <o 

|M  m 

<o  <o  « 


W  UJ  4t 

r  1^  Ik 

M  w 
«  a(  w 

U.  Ik  41 
9k  &  %0 

lAlf^ 
«  a»  flo 
«  ^ 

m»  ^  mm 
•    •  • 

<0  4»  «^ 


%  >  W 

«A  I/) 


lA 

Ul  IM  Ul 
^  9  » 
m  «A  1^ 
^  «  iO 


^  or  U: 

•i*  M  K 

s#  S 

CD  A  9 
■^C  « 

M 
•  •  • 

If^  u 

Q  UJ  Oi 
1^  U  U 
IV  lA  «A 

o«-i^ 
<  ^ 

<6  4> 


or 

Ik  ^ 
M  « 

ftj  oc 

C  00 


id4t 


1.1 

mm  «A 

^  o 
c 
*u 

>  M 

ui  oe 
&  O 


1*1  IL 

or  D 


oe  o  ar 
u*  4t  Ui 
^  z  o 

<  4t  <i 
te.  ft. 
O 

r  ol 


Of 
Ui 
(9 


X 

a 

oc 
o 
o 


u 

IX  U 


IV  O  IV  4>  O 
<M  10  M  •  IT 
fV  <^  tV  fV 

1^  lA  ^  or  •<» 

U«  UI  IW  Ui  IM  Hi 
^  #      4>  ^  » 

^  ^  ^  #  ^  # 

<0  «  ^  ^  ^  « 


Crf  U  Ui 
^  V)  w  c>  u 
«9  <  CK  X 
«  O  3  c  «^ 
^  ^  «  ^  ^ 
«» o»  to  o»o 

f«  iO  «P  «  ^ 

M  ««  ff^  ff^ 

•  •  •   •  • 

CD  «  a# 


«A  VI  ^  V>l/I 
IX  U»  U<  UI  UI 
»  O  ffi*  Ati^ 
^  IT  (A  IT  lA 
^  «  4» 


1^  . 

a.  ^ 
uioe 

V)      X«  <pl# 

or  OK  «j  V 
a  u,  1^  VI  2 

t^X  UlS  v^A 
ulM  ^  OUIUI 
^h, 

9  #  9  CO  OD 
lA9  4>IPI^ 

m«  9  #  ^ 

•  •    •  •  • 

00  -«  oi^lP  1^ 

ivi^  <nN ^ 
^UIUUUU 
^  VI  lilM  Mil 

lAlA  lAllllMII 
^  ^  4l<ft  4»<0 


423 


ERIC 


11%  9  Ml 


^  4>  <<>  «o  <r  «^  4>  < 

«  fv  m    m    ^  • 


o  o  o  u  ( 


«  a: 
v.  ft.  ^ 

£  «■»  1^  ^. 

4t  A 

r     •  > 

<  &  ^  « 

1^  IA>  i»  W 

a  «  A 

^  «^  & 
«^  < 
w  «c  .  « 

^  c  ^ 
•  •  •  • 

>  f 

lA  ».  «r> 
IM  to* 

«  ^  c  ^ 

4}      4r  <0 


X  or 
w 


u 

(ft 


X 

ft 


ft 


I  IT 

fir 


k     L.  < 


li  ^  ft 

4-  * 

ft  ^  c 

•  •  • 

^  OP  » 
fte  N» 

«A  a/i 
—  U  U 
ft  ft  % 
«  1^  « 
«  «  « 
<0«  <0 


^.  ft 
ft  u 


X 

>•  <  ft 

^  ft  u 

If  J 

*i     ft  :<  M» 

^  U.  M 

S  «l  X  Q 

-<    u  w 

<  V*  l» 
U  C  ftC  <  ft. 

o  ft^  w 

C  ft  L.  Ai^M 

fc*  U-  ^  LJ 

»  ft*  1^*  W  » 

^  ^  «^ 

flD  ar  K  c 

^  ^       ^  ^ 


^  ft  « 

ft  ^  V 

<  ^  w 

^  1^  ..f 
ir  «r  "n 
ft  ft 
u  ic  a 

•  ••• 

ftp  U  L>  UMUt«^-i«m 
mm  mn  r>4  04  (N  (V  (Si 

u  L,>  m  ^  <     «^  o  u 


ft 

ft  ^ 
C  ^  Ul 

0  :^ 
ft  -> 
r 

u     «  or 

W  >  to* 

»rt  -I  ft  •« 

w  >  X 

«  ^ 
^  ft  l*i 

^  ft  U 

4*  <r  ^  «r 

X  ft  ft 

ft  ^  «  ^ 

^  «K*  |M>  glA 
•      •     #  • 

M  ^«  «•  «^ 

U4  at  ft  ^ 
v%  ^  lA 

O 

ftt  ft  QD  9 

^  « <0  «d 


7 
ft  « 

ifc-  f 

ft  lA  u 

U«  MB  VI 
•-• 

>  «/>4 
ft  <  ft 
M  ft  ^ 

^  M  X  S 
7  >  ft 


^  ft 

ill  ^ 

^  £ 

u;  ftL 
ft  II* 

a.  ^ 

ft  m 


¥^  <  9m 

.-^  ^  ^  ^ 
•.I       toip  O 

Q  ^  ^ 
arfi:* 
ft  ft  «  ^ 

ft»  C  ft 

<  ft  IL 
tf^  IT  tf> 

ftt  ^  tt 
^OJB  ft 

•   •   •  • 

4»  ^  « 
^  <M  ^  1^ 

«4  «•  P«  O 

O  «A 
w>  o  ft 
U#  Ul  M  ^ 
IT  C  ^  ft* 
ft  «*ft  OD 
«Ci  «  1O  i« 


111  w 

ft.  ik 

>  3  JC 

O  ft  I* 
•rf  ^ 
ft  «^  K 
ft.  7  ft 

ll\  I* 

ft) 

«  ft 
^  ^ 

KJ  lU 
W  a  mm 

O  ft 
»  o  «• 
ft  9  m 
«  ^  « 


ft 

» 

ft*  ft 

ft  *  ^ 
M  ft  < 
ft  1^  n 

a 

ft  ft 

ft  ^ 

ft  s  e 
ft    p  » 

Ml  U*  ft  ft 
X  4fc 
^  «.A 

1^1  X  ft  c  ^ 
w  u  <  &  •>» 

c  ;p     ..I  ft 

(X  ISl  CM  N  ^ 

ir 

ft 

«  ft  fti 
•      •  • 

0"  tf% 
m  X 

«A  lb  ^  M 

ft  ft  fir  ft  dr 
^(l  <«i  iT  1^  tft 
»  »  ^  t^  <^ 

O  «  40  «  « 


o 

ft 

u 

ft 


ft 
o 


ft  « 

U  111 


ft  ft  M  ft 


5^ 
4tr  ft 


1^  IT 
X  ft 

ft 

IV  (V 
IV  » 
9  « 
•A  U> 
UU 
ft  ft 

w 


ft  1^ 
ft  « 

&  ML 
Ui  JL 

ft)  ft 
•  • 
IV  u 
U4  ^ 

o  — 
ft  ft 
>o 
9  u 


4r 
ft 

ft  6 

a: 

O  u* 
«i4ft 
u;  «• 

ft  ft 

•  • 

IV  # 
«• 

ft  « 


C  ft 

^  or  ^ 
ar  o< 

Ol  ft 
ft.  « 

CI    « a 

IM  Ul  & 

5  U  ft. 
ft  yjo. 

ft  ft.  fir 

6  »  ft.  ;p  ft 
ft  9 

•A  Ui  O  Li  ^ 

U'>  X  ft 
ae  <  ft. 
a  c  >  1^ 
ft  o  ft  ft  «A 

C-  r  C  Mrf  «A 
U  W  Ife  X  < 

^  ^  11^  aft 
M  ^  <V  i»*  ^ 

or  »  ft  QD  ft 

^  ft  ^  01  ft 

•  •  •  •  • 

^  ^  «iii  9  ^ 

1^  ^  MM  |f\  <M 

^      ft  ft 


< 
ft 
m 

M> 

ft  # 

ft  ft 

«i  o  u« 

mm  mt^  ^ 

ft  ft  c« 
D  iS  ft 
#0  <^  ^ 
M  IV  IV 
ft  dD  flft 


M  O 


ft 
Ul 
ft 

u 


ft 
ft 


13 
7 


ft  ^  O 


4>  ^  ^ 

u  u 
^  ^  ^ 


Ul  I- 

lA  or  u; 

1*1  ft. 
«i  c;ift 

ft  *«3 

«  W 
^  Ul  vi 

ft  « 
— ^ 

f«  #^ 
«i*  ^ 
n  ft  ft 

^»  00  00 

•  •  • 

u  «n  IV 
•  ^  ^ 
u  uui 


ft  ft 

<  ft 
&  « 

T 
C  ft 

ft  ft  o 
U;  ^  ft 
>  ^  ^ 

ft  «  M 

iW  ft  41 

B  u  re 

^ 

IV  ^ 
ft  fiPft 

^  a»  ft3 
•  •  • 

moo 


VI 


Zft. 

IS 

ft  ft 


o  9 


or  ft 

«i»IV 

00 


or  ft  ft  ft  or 
^  «  lA  «  ^ 
ooooe 


ft  AT  ft 

^  m 


«A  UIIW 

ft  ft  ft  ft  <ft 
<r  (^  4»  ^»  • 


r  ft 

U  Ul 

•A  > 
<  fi« 
ft  ar  ft 

••ft. 

7  Ul 
Ul  2  U 
Ik  < 

uift 

irf 

ft  ft 
ftifift  ft^ 
•  •  • 

^  IV  O 

«  » (^ 

Wl  Ul  Ul 

ft  ft  oe 
flh  o  <^ 


Ul  ft 

ft  «A4 

u  e  ^« 

X  C5^«» 

«-«CIUlM 

o  ^  •i*  I* 

t:  u  xu 

gu^uiai 
X  m0m  ^ 
a  ;«ift 

•  •  •  • 

iw 

nr  M^i^ 

M  ^  ««  M 


ERLC 


424 


r 


M  M 

&  ft 


or 

»  —  « 

*  X 

Ik  «  u 

i-  ^ 

-  ^  ^  < 

4r  i*.  s.  » 

*  c  C  * 

w  ^  — 

U  w 
«  «t  i£. 

*  #  4 

o-««»  — 

ft  O*  9  O. 

K  «V  IV  % 


o 

& 

X 

U  M» 
Ul  ^  Li  > 


Ul 


u.  L? 


r\.  *r  I-*  r*^ 


ft.  — 


¥o  .r  o 
^  X      ^  ^ 

cs  5*  a.  J?  ;r 


^     ^  < 

«^  t  :  X 

L>  <  < 

•di  .1  ^  :t  at 
<r  «^  ^  «f  ^ 
•i«o  o  «<« 

or  or  o,  or  Ob 
fs.  rv  ^. 


X  w 

ii«  X 

>  ^ 

o  — 


&  ^  oe  X 
u  <  w  •  ^ 

X  ^  ^  ^ 

*  ^  w«  U  i^* 
vu  X  u# «  ^ 
^  9L  uji      ar  X 

<     K  2r  u  *» 
^  r  < 
W     w  or  ».  ^  1. 

N"^  ^      X  ^  •'^ 
<  u«  O  O  M 
or  >  «■     a  c9 
«a  u     ft.  < 
^  ^  m0  ^  M  ^ 
^  O  ft- 

^  <r  ^  <r  %r  ^  ^ 
f-  c  o 
9  X  a  a>  cr  95  « 
^     fv  *^  «v  *^ 


c:  a: 
c  ^ 

I 

ft.  1. 

a  CD 


or 


;r  y  < 
or  <  C  & 
»  o 

C  i*i  m* 

•rf  a  Of  M 
c  »«^< 
ft.  X  «  fir 
<  ^  ^  «r 

mm  mm  m» 

X  V  Q» 
1^  <V 


^  ft. 

<  flt 
4. 


o 
fir 


2?  « 

«  <  a» 
Q 

«/)  1^ 

2r  £  ft. 

*  «r 

»««  ^ 
a  d»  « 

CM  M  <0 


O.  ft. 


Ul 


ft 

UJ 

o 

UJ  «  ^  ( 

^  u.  . 

,?f  I 
X  «  , 
u  ft  ^ 
<  ^  •» 
ft.  «s 


<  « 

X  X 


as 

41 


'  at 


CO  i 


1 


UJ 


at 
tti 
I. 
ft. 

oe 


c  >  c  ^ 


^  U  «^  «r 


«AU  AT 
Li  ^ 

IL 

^  «r  < 
«<•  o  w 


Ui<  « 

i*»  ir  n* 

^4  IN.  MM 

at 


at  — 
^  r 

i/» « 
s  X 

OU 

a:  Ul 

^  jL 


u 
u 

nc 

^  41: 


ft.  S  80  « 
fV««  «^ 


ft 

Ul  Ul 

S'- 

&  ^ 

ft.  u 

u  ^ 
«^  1^ 
ft 

»  ft 

—  Q 


«; 

ft  «f  ui«f 
<  w  X 

^  ft.  MM 

e  or  19  > 
A  «  .«J 

Ml  ^  «4  « 

9  ft  (9  «>« 


ft  oe 

u  u# 
oe 

40  « 
£  S 
<  4 
ft  V 

^ 

y  u 

— •  N» 

*•  u 
< ;» 
ft  a 
«iu 
a  a: 
;i.  ft 
^  us 

OD  ft. 


oe 
oi 

ft «» 

UiO 

<  ^. 

4? 

«r  Ul 
ft.  > 

mm  S 

U.  ft. 

4l  e 

ft 

^  4t 
Ifn  ^ 

»mm 

^9 


ft  ^ 

UJ  O 
;ai  ^ 
jr  ml 

mm 

O  • 

4f  ft 


<  ft 

sr  — 

X  ^ 
u  a. 

Ul  3 
ft^  n 
^  c 

mm  ^ 

CC  ft 


or 
u^ 

Ul  ft 

if  Ui 
Ul 

uir 

2!  Ul  M 

OI  JC  o 

•J  O  iv 

O  Ul  «ii 

too  «IM 
9  4  M 

ft  u 

ft  Ul  Ul 
M  X  -4 

a  u  Ul 

41  4»  to 

*4  ff4  fl^ 
ft  ft  « 


ne  U. 

Ul  or 

•»or 
o  — 
mm 


u« 
U  Ul 

o*-  # 

ft  O  ne 
^  jr  Ul 

W  U4  Ul 

<  M 
•»  lA  td 

Ul  Ul  7 
ft  ^  Ul 

^  <l»  ift 

« cr  « 
coo 


uisr* 

Ul<  iC 

OU# 
^  •»  Ul 

o 


cr  ft  o 
M*  ^ 

OOm 

sroftc 
ft)^ 


^  «^  (M  O      i><V  0»  L»  4A  «M 

ft**^  «l4l4»tO^OU^a<£>4;ft« 
A       kl  ^  »U  Ul  «^  Ui  **l  4J  4.*  141 


ftivftftorft;ftftftor 


►  ^  ^ 


ft  ft  ar  ft  ft 
t4»  ^  ft  c  O 
1^  ff\     m  *f 


^^•«^CMr«Vi««OC»<^»N'»OOIV9^^««M^'<«U«n«^«^CM^ 
W<..*^•U(Vfi•«V^««■«4l«^4lm««lM4<%ft^M0^1>U•<4U^UMlU 

4»x^•cft*oft(^4l«^ftll%u&«uf^^u>40^»4l«4l^uououoo 

S«IUU;^UU*»'UJ«tfH4JUJ*^VtMlAUifUU«AUII^WU.4l4lftlA 

•  •»Mi«M««M4i/iiA«i%«i^iiiaiteiuou«ft«>oe«-*"*M«»«>Uft 
UirftftftftftftftftftftQrftQrftftftft««M«oa:ftftftft«»"»' 
•«iM<^^ir<»f^ft»9'0«i4(v<v«^4N«^p>o^o««fM^^tf^^^aeo> 
ir•^^«r«#«r•r^t#l^l^ln«^l^lr•Al^lf^l^^«^tO«4»«^4»^4>< 


«^NliJl«el^o^»•lft«ft»OMuuvu 

UUUUL>U«*UUUUIUIU4U<4lUl 

ftftorftftEftu»«A«A«A«*««aBorftae 

flMMaMMMl/l  UlUiUjgr  ft  MMMM 


««MO 
O  UO 
Ul  Ul  Ul 

ft  or  ft 

«  ^  00 


•4M 

ft  ^o 


425 


ERIC 


o  « 


< 

r 

D  > 

• 

mm 

^  t  ^ 

i  t  U 

u.  C 

a.  < 

i:  ^  «*. 

✓  a 

.f  ✓ 

a  < 

1.  or 

* 

'  *  a  ^ 

v: 

> 

t  i/> 

—  ^  < 

^ 

c  «r 

»^ 

••f  r* 

*• 

:::  ~  a  u 

c  ^  u. 

» 

U  ^  & 

u>  IT  & 

ft   t    <^  JL 

U  3 
^  SL  X 

^  < 

5r 

IT      ^  ^ 

*t  ^ 

—  a. 

Cfc  * 

c  s  a 

r  ^ 

C  #-«  iTi 

• 

IS  — 

IV 

• 

•  •  • 

•   «  • 

u 

^  fi^ 

S  ^  OD 

4>  09 

o  — 

i>« 

^ 

C#  UJ 

iMt/t  u  or  «K  oe 

U  u# 

ft 

%n  ^  1^ 

^  #  1^  ^  & 

0*  Q  — 

»  5^  e  y  C  8^ 

COO 

9^ 

|k»  |k»  9^  ^ 

^  OD  OC 

a  Y 


-I  If 
c  ^ 
1/1  «^ 

at  dr 

(Vr  IN* 


O  O 


IV  > 


^  ;r 
^  •* 
>. 
&  a 

a. 

<t 

C#  44. 

^  ac 

m»  mi 

CP  or 

<Ni  IV 

o  o 

IV  IV 

« %J 
c  o 


ai  mm 

V  > 

M  or  < 


ar  uu  ;t 


X 

M 

>  ft 


^  ^ 
s  a.  «t 

U.  C  fr- 

a  i/i  jff 
>  c 

CP  S  X 
IV  «^ 
•   •  • 

<^  <v 
m  ««  « 

M  M  «a 

U 

OCIV  « 
^  Ob 

o  o  c 
e»  or  CO 


Of  « 

«.*  ^ 

c  ^ 

Q  ^ 

«  e: 

rf  pt 

Q 

flC  cc 


ft  ^ 


or 

ui 


cc  y  V  ^ 

«  «  >-  « 

»  w  «A  r 


I.  X 


pdi  ^  •»  < 


cc  cr 
IV  r*4 
•  • 


ft  ft- 


a.  ^ 

Ct  ft' 

IT 


r  o 

« «        or  ft* 
iif  vj  u        M  or  Ui  iu 
<  ^    9c  «ui«^ 

o     ^     o.  1l 

X  4*  U      &  S 

•->ft£^ftxuaa 


(V  (T 
a:  M 

ftt  ft' 


CB 


e  C  CP  flb  «  c 


•-lv^^•-•^^•* 

CDCoa.ec««a& 

•  ••••••• 

99COCtOb'CDCtC9 


at 

ae 

UI 

r,  mm 

ft  u 

»» 

<  &f 

X 

£  U 

v! 

-  X 

< 

CI 

^  o 

ft: 

u. 

«: 

'.U 

X  z 

^  «J 

< 

or 

o 

uu 

X 

Ci: 

ft 

o 

^  o 

< 

< 

^  Ml 

ft 

UI 

UIO 

ft 

A  O 

M  111 

v> 

V>  UI 

^ 

U.  Im 

w 

UI 

Ui  al 

Of 

UI 

1^ 

^  1^ 

•# 

4t 

09 

CD  9 

7? 

CO 

ft 

CO  ct 

O 

O  1^ 

I\ 

1^ 

• 

• 

•  • 

•  • 

• 

• 

•  • 

IV 

(V 

IV  09 

<^  ^ 

fti  ft* 

cu 

41*  IV 

O 

u 

•41  ^ 

w> 

«  UI 

uu 

O 

UI 

< 

« 

oe  Of 

er 

|k»  CO 

9  O 

(V 

M  <V 

^  r» 

1^ 

or 

CO 

CC  0> 

C»  ft» 

CO 

CO  O 

X 

o 


^  O  ft 

^  ^  M  W 

«A  <  s  ^ 
X  « 

wlllUftt 
«t  «■  UlU 
7»  l/l  «-  a 

<  i#»  41 
«  U  «l 

X 

U  X  w 
ft;  U  O  < 

<  «  ac  U 
^«  t« 

t/>  Ui  O  ^ 

<  m  u.  oi 

UlUri  arf  X 

St  ft*  u. 

«r    « IT 

^  PR*  914 

a»  ft:  CO  ce 

IV  ^ 
•   •    •  • 

M9  0»  M 
4r  ^  ^ 
O  ^  ^  O 
V>CC  .lUI 

uiu  oe  ftt 

M  M  M  M 

lA  «  A»  ftt 

1^  #^ 

fle  ct  «>  c 


— 

^  oe  Q 
X  < 
ft:  J»M 
4e  I-  ^» 

XUUl 

ft.  4  ^ 

tfMA  «l\ 
«  «> 

09  vo: 


1^  IV  (V 
UI  Ul  fit 

c  u  *^ 
#»»  #  1ft 

CM  CD  ftf 


« 

ul 

I  in 
'  CO 
U 

oc 
«^ 
X 


5 

Hi 


« 
u 
a 

«c »» 

ft  ^  ^ 

UI  ^ 
X  <^  W 

A.  <  4tf 

«  OX 

o:  < 
C  X 
U  UI  s 
X  w 

lA  iriA 
ct  » 
ft;  CO  a* 
O  M  O 
•  •  • 
IV  <ft 
IV  IV  ^ 

»  o 

«A  UlU 

or  o(  UI 

f«*  MIA 
^  <  dA 

^  ^  # 

CD  CO  Ot 


o  ^ 

^  M 
«A  ft 

o 

UI 

X  u 

MU 

^  u 
«l>  « 

90  9 

ft;*  » 
•  • 

M  IT 

eo 

CD  CD 


^  UI 
O  X 
X  o 
u  z 

-K  O 

X  a: 


1/1 

M  M 


M  I 

u 

X 

t/»  a 

M  «  ^ 

19  ft.  at 
C;  Qui 


9e  «A  X  X  — 


QD  OS 

o  o 

•  • 

at « 

ft}  » 
«  <# 

aD  9 


X  X 

CD  CD 
OO 
•  • 
<*l  IV 
(V  IV 
O  O 

at  ar 


CD  oce 
«  ^  « 

M  CO  M 

or  Q  a» 

Q  — O 
•   •  • 

^  «•# 

♦ 

O  OO 

at  o(  <A 

«A  ^  UI 

I  M  M  M 


CO  00  CO  ooc 


^  I. 

OlA*! 

xii; 
a  o 
«tft 


OO 
^ivi 

OO 

uior 
ifiiftft 


ERLC 


426 


mm  m       9^  ^       ^  ^  ^       9^  _ 


mm  «P 


«r  — 

^ 

—  u» 

^  ^ 

cr 

s  % 

ft.  «  (T 
O  O 


mm  i 

u 


«  —  pJ 
«  «^  M  < 

^-  —  U> 

ecu 


lij  ^ 
^  «/»  <t 
O  -  ^? 

*^  %r  < 


«^  X 
UI  -J»  *• 


mm  ^  ^  <;  t/^ 


y  ce  or  «  s 


ii  — 
c  -« 

4f  id 

ai  OR 


mm  lA 


<  CJ  t 

—  >r 

u  nr 

C  L?  *f 
*^ 

C  O  « 

»  QU 
CD  QU 

o  o 

<  < 

^  «  <tf 
«>  or  o& 


U  u 

ux 

pa*  mm 


1/1 

c  r  w- 

o  G 
&  > 

^  X 
wo  ^  a 
c  c  ^ 
X  &  o 

o  «  o 
^  I- 


^  o 
<l  u 

o 

1^  u 

^  u 
X  w 

a.  X 

^  ^  o 

^  -.-^  «A  <y 

40  u  or  a: 

^  ^  a. 

r    A.'  «t  Q 

u  X  —  « 

>>  H>  ^  C  ^ 

<t  «^  X 

«p  teMf^ 

;0  39  SB 

oooep 

•   •   •    •  • 

V  9  9  C^  ^ 


—  ^ 


mm 
^  < 

%A  or 

UI 

£  «  ^ 

-J  —  if  u 
<s    <  u 

U  <  U4 
—  i  u 

;3  ^  ik 
^  «->  ^  a. 
z  V  a  u 
a  X 

«  «  » 

^-  fte  i"^! 


u 
> 


oe  A 
^  1*4  ^  lA 


f«%  *  -  ^^^^^^^^^^ 


f«  o 
u  < 
<  »A 
lA  — 
o  — 


flP  9D 


o  o  c* 
4  <  < 

«  M>  to» 

#^  ^ 
^te  1^  li» 
op  flP 


^  O  O  O  i^ 

7^  «  ^  o 

^  fte  fte  K  X 

flC*  CP  8*  9  flD 


<^  ri%  1^  9  ^ 

o  o  o  o  «^  o 
at  lA  or  ui  *A  ^ 
^  ft  < 

M  M  ^  lA  flC  ^ 

iM     «k  «r»  ir»  <e 

0»  0D  X  X  dC  0D 
IS  flp  90  CP  flC  OR 


^  ac  ^  •A 

C  ^  w.  Jrt 
»  ^  X  < 

«^  «l  u 
<  < 

—  -rf 

U  U  CD  ^ 

(s  u  ;d 
no  a.  £1 
ir  ir  i* 

CC  QE> 

^•'  o  «•  ^ 

mm  9^ 
•    •    •  • 

«^  ^»  IT 

f«»  <^  au  ^ 
O  M  «>  u 

MJI  M 
V>  «A  ^  C/1 

^  o*  (^  o 

dD  A  QD 
09  CP  CD  C6 


er 
T 


< 

i/t 

X  < 

«w  vn 
<  ^  ^ 
ui  ^ 
«r  u 
^.  OTi  «* 
c:  o 
<t  ^  ^ 
i«  ai 
«  «^  ^ 


cr 


ft  u 

w  < 

or  UJ 
u-  a 

c 


X  « 

u»  ^ 

^  M  r 

£  U 
>-  X  i«i 
sr  UO 
c:  « 
^  ^  _> 
«  t/) 

iJ  < 

(X  ee  Mu 

«0  I  tt 
«pl  K  ^ 

itf  <r 

^  A 
«  «  S 


•  ••••• 

A  (^  ^»  c^  o  11^ 
^  1^  1^  M  ^  v» 

u  u  o  uc*  « 
1*1  u  «^  u 

i/v  «A    M  M  cr 

^  0.  ^  9»  c»  ^ 

9  ct  CO  cr  4>  flD 


C.9 


ar  u 

111  u/ 

M  rr 
o 

X  ^ 
X 


•  • 

lf% 

uu 

or  er 

09  fl9 


—X 
«  X  U 

OC  U  4 

UI  a  ^ 

ft.  X 

c  w 
X  ac  — 

«  ^  « 

<  u 

Mp'  ^  ^ 

.1     A  ft 

<  ^ 

;0  Ji£  ^  ^ 
#^  #^ 

CD  ^  ^ 
O  X  09  09 


w%  1*1  ^ 

Mi  «M  o 

IS*  CM 

or  OB  oe  K 
u w>  uu 

0"  O  PO 
09^  ^  ^ 


ft  u 

u  or:  or 
^  iw  u 

4t  ^  H» 
ft"  u  < 
u.  ft: 
a  ^  u: 
O  «  ft. 

u  u 

Ui  M 

^  •»  or 

M  «A  LJ 
X 

U*- 
4  4 
^  OC 

o  ^ 

c^  iM  af  M. 

o  «^  2r  1^ 

li.  U  W  X 

*J  «<u  o 
<  u 

U.  U  «  X 
tf\     tfk  ff\ 

or  CD  (D  IV 
oc  Oi  oc  09 
4^  ^  tT 
•   •    •  • 

^  ^  m 

^  mm  mm  mm 
(MINI  CM  M 
1/9  C/l  «A 

U  UU  u 
M«  «  3 
PP  UP 
»      ^  9 


ft; 
u 


or  ^ 
u»  v> 
C  - 
U  ft 
>• 

&  fe» 

I** 

CD  99 
ft*  09 

•  • 

u  u 
CM  rv 


U  u 
p 
PP 
P  » 


oc 

oc  u 

KM  OC 

a  ;A 
u  X  oc 
ft  ^ 

Ml  <  < 

«  or  M. 

X  u« 

u 

<  Ia4  «/> 

aiL  f  ^ 

t/>  CJ 
uj  I  — 
U  K  c 
M  or 

ft*.  UI 

L>  u  ar 
<w  ^ 

C9  »  09 

p  or  ^ 
•  •  • 

«0  CM  9" 

u 

CM  CNi  rsi 
or  < 

u  uu 
p  p  — 

P  Mpirt 

1^  ^ 


or  or 
Ui  o  or 


%^  X  ^ 
u^  UI  or 

UP  ft  UI 

o  u  a. 
X  O 

a  J(  ut 


^  oc  X 
or  Ui  u 

OU  ^  <l 

U  or  ft. 

or  U 
a  a  C 


< 
or 
«  3 

}f  < 
cr 

Ui  «^ 
^  ai 
u  y 

P  9 


or  M 

ur  or 

U  O 
ft  ^ 
ft  P 

^  p 


•  #  •  • 

9  pi»  m  m 

U  ft>  09 

Pi*  •«  CM 

M>     M  m 

UIU«^«* 

U  ^  Ui  u 
cv  «^  <r 


^  P 

VI 

X  ^ 

uu 
<  • 

IL  M  ec 
c  u/ 

ar  y  p 
c 

ft  s 

Ui  ? 

Ui  C  Ui 

K  u 

K  U. 

c;  or  1^ 

p  Ui  O 
<t  ^  ^ 

P  9 
Ob  ftf 

•  • 

lA  cr 
rvM 

I/)  UI 

CI  u  u 
iO  ^  P 


or 
o 


ac 
ttJ 
a 
o 


X  ' 
U  ( 

m:  <  I 
*  ft 

UI  4 
^O 

u  ar 


p  p  cr  p  p  p  p 


7U?K 
C  «  IM 
«A  tfi  ftC 

or  ocji 
^  ^  ^ 

P  CP  P 

PPP 
cnfi% 
•  •  • 

o 
u  ^  u 


UI  or  ui««  ^ 

^  CM  fv  ^  ly 
p  p  P  p  P 


O  D 

or  o 
u 
<u 
ft  4t 


ERIC 


427 


! 


^  «  «^  ^  #  ^  

«  ^  «  ^  oi 


m  «0  K  ^ 


i.  t-i  <  X 


X 

ar 

u 

€ 

<r 

ft 

X 

^  >• 

W 

^  ?r 

c; 

•  * 

& 

< 

u 

< 

✓ 

<  •< 

A. 

•t  ^ 

Ml* 

L  >• 

IT 

M  S 

r  w» 

• 

CI 

MB  te« 

*r  J* 

*• 

X 

Mi 

Oi 

I*. 


C 


c 


at 


««l  U  fit 

C  i*:  -iw 

<  < 

^  ✓  K  — 

<  -  #^ 

-*  *t  «1 
kJ  ^ 

>  u.  u>  ^  ( 

2»  C>  «r 


4.' 

<  ft 

t  9 

»r  IT 


^  <?  ^  ( 


^  U>  tf*  o 

<  t  — V 

IT  IT  ir  IT 

X  dP  9  4D 

P«  «  X  s 


^  X  < 

X  — 
t>  •'^  ^ 

9C  ^  4^  ' 
>  <  »A  L»- 
«  « 

^  «  9 

ft  '  ^  <r 
O  ^  <.i 


M  ✓  cr 
o  UJ  u. 

^  ^  4 
^ 
< 

U  ^ 

^  Ui 
<X  fi.  u 

^  .J  a 

<  U  ^ 
o  c  ^ 

^  X  Lf 
Ul  MO  .J 

«  <  ^ 

4»  9  X 


m 
> 


^  Ui 

«i  >  < 
I-  ^ 
7  ^  w 
3  <  tt 
O  V 
U  -» 
UI  « 


III 


a: 

«  i*.  1^ 

UI 


1*.-  'mi 


c  y 
•  o  — 

I  or  ^ 

'  CD  S 


—  ^ 
^  lA 
O  9 

c:  <  o 

^  UL  M 

—  u  u 
i..  H  ft 
»  u  u  u, 

^  UI  M. 

ar  9fi 

IM  MB  « 

u»  C  C  s 
tr  o  IT  u> 

«  «  6B 


ft 
u 


u; 

^  QC  UI 

w>  u  u*  o 
e  — 

^  M.  u  4 

q;  III  u.  u  o 

U  OP  — 


ar 
c 

ft. 


u.  at 
&  u 


U  &  Ui 

—  u  > 

>  u  rr 
ft 

u*  u 

^  w  U. 
U 

i7  ae 
C  u  < 

n 
1^  V 
dc  <  ^ 
u  X  ^ 
u.  o  — 

tf^  ^ 

Oi  O  X 

<o 

<p»  ISI 


7  u: 


Ui  Qu  u> 


17  fi. 
O  lA 

uc 


uu  « 

>  Z 
C  — 

oe  o 
a  or 
a  ff*  o 

41  Ui  UI 

ap  Ui 

4  QC 
U»  < 

zr  u.  ^ 

UI  u  UJ 

c  X 
> 

4J  « 

til  UI  2 

>  «^  x;  < 

C  H-  X. 
^  O  ^  UI 

a  c; «  OK 

IL  U  U.  U 

Ui  w  X  u 
«t  #  «r  4^ 

CP  OP  ff  1^ 

« fTk  ^  m 


Ik*  ^ 
41  « 

oe  or 
u«  lU 
ft.  & 
CJ  u 

Ui  X 

O  «t 

X  «r  ' 
a  1 

ut  u:  i 


«  oe  oe 

Ui  Uu  iW 

o  c  o  oe 

4  4(  «  Of 

I «  «  «  « 

X  K  Z  7 


<\i« 

at  its 


u 

I  OS 

I  <0 


a 

o 

3  <r 
C  ft 
M  U< 

or  a 
fr  C 

IT  IC^ 
OB  09 


UI  % 


X 

OD  CD 


^  at 

Ui  Ui 

r  UI 

or  IT 
«  u  ^ 
Ui  ^  o 
o  ^  s 
41  <  oe  UI 
« ^  u 

^  ^  U«  «  Cft  4 

«  cx 

O      C3  ^  UI 

««»«^soeo 
^  M«    oe  ^  lu 

f»  ^  OB  MM  oe 
or  oe  M  or  7  o  < 
u.'  Ui  >*a  M  < 

>  >  X  OB  X  « 
C  O  <  <  Q«  O 
«  <  ^  W<(d  4 
^  IT  3lA  ^  «  U\ 
09  OP  C  S  1^  00 
p4  «.«  O  iP 
«i«  O  M  Mi  <>  ««  M 


0M^«^ou^m4i«*4i(^<«iflDmi«i»auoP(^«i«i^4irt<«i^^iM^<r0Daiaut^4i«i«««€i^^ 
yw*ii^i^i/iu>ooMiAi^arMiAui**Muiuit^iAu^ar  ^»«u*«uiuiui<i>OMtMou>Qe"»UiX^xou>*^ou>«A<^ciajui«J 

^  MiOi^*--  X«A(/^  M  UiUiUi«M^M«/»^m»M^^^l^lAM^^4jMMQf  UIUI^«A«rtU<UikMUl«A«»OrUi«A«AlA«AUIUKtflS««ttl 


U      O  *^  «1  ^ 

^     <0  a*  > 

N      M  fS,  iM 

^  ^  ^  ^  ^  T 


UI  U*  U'  W  O  U  U  < 

Op«>ii«^#ir^»»oc 


UUiU^^^V«U«U*U^UMUlU^UiV>«^^M»yiUiUll^V)^^0eOUU^I^ 

(j»«»iVM«u^o^ft2  Ch»p  ^ivM^iA^^cco^o««i\i^<^ir^«^069  O*^^''^^ 


_  -  ^  ^  :  •  ^ 


428 


ERIC 


Mil 


5*" 


^  *      O  ^ 

4>«  fM  i£ 


<  ^  4  W  O  O  IT 

^     fv:  «r  4t  o  ^ 

Q  p«  P-«       IV  ^  ^ 


o 

CM  U 

-8 


• 


i\      ^  ^ 


—      w  O  —  C  ^ 


M  ^  O       <^  ^  CNi 


^  O      (S«  Ni  < 


<vi  a»     «r  cy  f*» 


<  or 


flL  s»  •'M  <r 

U  ML  IL  ^ 
O  OU  «l  «l  c 

41  U  C  «^ 


>  «  «  ^•  o  c 

3      p..      fM  «  Ni 

c  — 


u.  ^  o  o  o  o  « 

Wi 


u 
u 
o 

c 
u 


^1 


^  O  O  O  O 
M  ^  CO 

U  —  < 


M  O  ^ 

^        fStm*  ^  X  nC 


Ui 


3  ^ 

Ml 

>  ^ 


X  M 


u.  a  fv  o  u  I 
K  >     ^     «  <r  • 

Ml  J» 


>  4 


p«  9  p>*  o  O 
«M  ^  41  ^ 


r  or 

>        a     <^  < 
o  ucu^wcxxxo 


3 


i#i  XT  a 

O  «  X  UI 
X 

X 

^  o 


•  er|c 


429 


KSI  cow  MHUBIi 


.09 


X. 

C  3 
£  I  0 

4^  C  «.  >- 

^  c 
*  o 
«  c 

c  k  «^  i-i 

c  ox 

*^  w 

1.  <c 

5  3  * 
d  o  «^  «^ 

a  or  « 
u  o  o 

CM  ^- 


c 

10 


M  0) 

Oi  jC 

b  3 

0. 


c  E 


u  ^ 

cc  c 


E 

X 


o 


4^  C  ^ 

€Z  to 

r  X  X 

U  4^ 

to  <c 

>  c  c 

c  c 

e  o 

o  4^ 

4««  0) 


O 


01 

> 

It 

X 

5 


W  C 

10  fee 

c  » 

in 
C  in 
^< 

a 

0  *^ 

in 

c 


C  U 

c 

O  C 

X 

Ift 

lA  o 
O  t£ 

X  X 
*^  £ 

3  c 
O 

>  a> 
c 
10  o 

in  Otf  in 
m     t)  0/ 

CO  S 


c 

c 


b 


b 
c 


<o  o 
o 

X  u 

U  3 


u 
c 

8 


in 

0  in 
c  c 


•  V 

ft-- 

c 

m 

C  C 


in*-  c 

CDC 


4-»  t: 
c  a. 

^  c 
c  «^ 

>  I. 

E  c 
o  o 

>%  c 

—  D 
C  "Z 
C  C 

cn  lu 
0.  C 
> 

C  O 

(C  X 
4^ 

t  c 


4-»  O 

c  c 

3  10 
UX 
C  ^ 

o 

in 
4»  in 

X  Q; 


*G  in 
c 

> 


c  c 
X  in 
lA  0^ 

X 

c 

• 

^  c 

in  c 

Q«  4^ 

I.  <c 

3 

in  c 
c 


in 
h  ^ 

C  4^ 

-o  % 
c  q; 

a 

Ste 

u 

X 

C  "O 

c 

0)  in 
c 

4-^  O 

o  u 
c 

o 

in  in 
*^  Q 


in 


ft 
u 


U  X 
4^  c 

4-»  C 

ro  c 
X 

4^ 

>  t: 
U  — 

«<  c 
o 

C  t. 

c  <t 
—  t 

U  i. 

S  Zi 

X  o 

*  <c 
c 

°b 

4-» 

u  c 

3  fe^ 
^  CI 

o  c 
o 

X  • 
in  -r 


in<NX«3'i.K%0i-'^4^^CK\in<<nX>o 


C  in 
o 

^  > 

X 

4J  4^ 

in 

^  C 


3  C 

0  <0  IT  4; 

C  4J»  c  o 
—  COS 

m  X  u 

C  <0  3  ^ 

^  ^  c 

4^  IC  O 

rc  >*-*x 

C  ID  Q  U 
3     0  in 

O  41X 

^  w  t>  — 
C  Is  in  c 


4-  >  4^ 


3  0 
O  > 


0^  10 

>  c 
41  o 


—  <0 

n;  u 
c  3 
0-c 


49 

X  in 
4^ 

O  > 
4a  ^ 


lu  C 


U  X 

3  4il 

4.  o 

X 
IC 

4? 

c  o 


•n  X 
i5  % 


c 

3 
4^ 

t. 

4; 

a 
c 
o 

4^ 

Q 
U 


3 
O 


X  IC 
«k  E 
41 

icx  in 
4.'  ^ 
C  49 
fes  C  > 

in  I— 
in  in 

IC  4->  4JI 

X  c 

C  K  Q 

x'^  4; 

I-  J  14. 

<c  in  o 

10     in  *4 

a< 

c  3  44 

t6  X 
I'*  c 

in  4i  10  ^ 

10  3: 

O  a 

in  4-*  3  4; 

4i4^  C  in 

4^  g 
O  41 

X:  ^  C  X 


O 


U 
3 
O 
X 


in 

oi 
> 

41 


in 

4»«»  <6 


4^ 

>  , 

10 

X 

3 
O 


10  4^ 

in 

3  10 
O  4» 
>^ 

C  u 

<C 

X 

^  3 

O 

3  > 
O 

10 

X  X 
U  4b» 

2  — 

3  4) 


I 

a 
o 
>- 


U' 
9) 
C 
C 

I 

4) 

E 
10 
in 


8 


X 

u 
in 

41 

tc  ^ 

4)  10 

C  X 
«      ^      O  U 

o    p.  in 
4»     u  ^ 

C  X 

—         «  w 

CO.       O  ^ 
UfH^^r^  >«x  ^ 


< 

8  S 

X 
If 

i 

2 


430 


ERIC 


IT  c:  CM  oc  .rf  i  .* 
O      iCt      J9  C4 


u 
c 

u 
I/I 


O  KN  CN  ID  00 

uc  r*".  lA  ^ 


c 
o 


u 

01 


O  rH  ^  ID 
rA  fSt  <M  fH 


u 


o  o  o  o  e 

C  .rf  CM 


10 


o 

3 
C 


o  in  o 
lA  rA 


-sr  CM  fi 


C 

c 


0. 


o  iH  -rr  CM  in 

fA  CV  CM  IH 


O  00  CM  CO  OO 
CM  N%  M 


u 


o  «tf  lo  00  .sr 

CM  r-i  iH 


c 


8 

u 


o 
4i 


«  S  8 

c  X 

o     u  u 

M  M 


6^ 


•  9 

o 

a 

»  z 

O 

tc  Ul  o  o 
o  o 

V  c  u  u 

V  P  w 

—  le  xx 

—  ■  u  u.  ^ 


ERIC 


to  o 

c  s 
o  s 
o 

u.  .  o 
c  o 

o  a. 

tJ  to  h- 


OOUBSEWHITER 


Op 


X 


c 
o 


c 
o 


0^ 

c 

HE 
w>  X-  K 

»^  o 

^  %r.  cz 


a 

3 
U 

u 
o 

£ 

u 


c  .  K\  SI  »  i:  i: 

Of^  <  CO 

^"s.  s:  CO  u  o 

c  9-4  c;  0^  o 
s  c  a  a  o 
c  ««i  >- 

>-  CD  K  4^ 


I  I 


O 

3 
C 


I 

CM 


U  W 

u  ^ 

w 

^  U 
P  OO    ^  . 
^  O 


1^ 

e; 
c 

9 


N 

1/00 

'^-^ 

c 

0 

CM  W  CM 

<0 

Q 

b 

3 

«H  M  «D  jD 

4)  lA  P>»  i—  £      S  Cl» 

<  c 

•H  CM  K\ W\       XL  ^  C 

CC  3  C 
•   I    i   f   I  ^CX.^  I 

CM  CM  <M  <M  CM  C/)  CA  p- 

3tU  »  3 

X o.  ax 


U  M 

u  ^ 

U  00   %  p 
CM  X  u 


1^ 

b 
o 
■o 


3 


cH  CM  )A  M\ 


Z  10 
<  V 


01  |Af-_Jj 


r-l       ft      f-i  C  (J 


•H  CV 


I    I    I  I 


0. 


£  *  3 
so  V 

<  o 

ff-4  4iJr4 
3MJ  «  3 
O  A.  fi  O 


i 

CM*^C 
OOP  * 

ax  -tjx 

IH  €M  K\  «9 


1    1    f  I 


ERIC 


c 

mm 


> 


4f 
0( 


^  u 


u 


lA  w  lA 

<S*  O 

U  00  ^  U 

'•s.  -a-  o  c 

CN  j::  4^ 

trt  —  —  z 

f^J  1^  tr 


c  c  a*  £ 
I  I  j:  o     jc  I  III 

^  CL  C  ^ 
>- 


o 

i:  o 


c 
c 


u 
0; 


o 


I  V 


c  n: 
c  a.  a  a 


U  CO 

w  U 

t;  ^  u  c 

CM        O  ^  <L 

-V.            X  U 

rH  Csj        C  ift 

CI  X  ^  — t        C  3 

c:  C 

o  :  _  u 

c  c  u  r 

I    I    I    I    I    c  o  t/)  C  I 

^         0^    rH 


POO 

u  ^ 

CM  'S^O 

i-H  csi  in 


u 

ID 

c 
o 
u 


in 

c 

3 


x;  T  Xi  » 

lA         £     Z  C 

<  O 

est      ^  ll\      J.  U  O 

c  r  c 

OC  3  O 
I    I    I    I   I   U  CJ      u  • 
f»4  i-H  fH  fH       in  I/) 

3  LU  01  3 

>-  >^ 


3 


00 

ooo 

00  w  00 

u  ^  U 

u  00  ^  u 
v*^o  3 

M  CN  Xi  X 


4)  lA  X  M 
r-i  CM  K>      W%  O 


•    I    I    I    I    I  I 


C 

c 


c 
u 

ft 

X 


I? 


oc 


ERLC 


X 

£ 

X 


t 

c 


c 
> 


c 


o 
p 

s:  t.,  c 

r  ^  o 
fe:  r  —  few 
a»c  o  0) 
^  o  o  ^  • 

c  ui  0)  c 
u&  a  u 


CM  V* 


CM  K\ 
I    I  I 


U  ^ 

w  ^  O 

X.  u  c 


u  u 


U  U 


U  U 
u  u 


c 


o 

P  P 


% 

P 

o 

P  P 

-  E 


% 

00 


% 

M  ID 


P 


i9      .9  <9 
%       %  % 

O      ^  CO 
tH      ^       «SI      M  M 
%        %        %        %  % 

P'^P^  Pv^P^P^ 
PPPPPPPUPU 


lA  (D  00 

I  I  I  I  I 


I  I 


I  I 


^  lA  ID 


I  I  I  I  I 


^  c 

I  I  I   I   I  I   I  I  I   I  ou 


s 

• 


s 


9 


8-" 


X 

C.XX>73  . 
ft  M*-  *- JBm 

rt  CM  K\  lA  II 
I    I    I    I  I 


ERIC 


434 


% 


% 


CS  I^N  4f  N  lA 
^•-4  Ai^X  1^  JC  i-t 

X  c.^  a«c  dlD  CI 


u 

f4  00 

u  u 

■o  a 

—  E 

CM  CM 


i  I  I  I  I  I  I  1  I  1 


% 

IS 

JD 

ID 
•H 
U 

W 
1 


< 

v>  c 


u 

mm  M 


I 

U 
M 


Z 

9 


M  lA 
r-l  fA 

fH  CSi  rA 


Si  i 
^  o 

®  •« 


CM 

U  i>  u 


«criA  ID 


i  •  I  I  I  i 


u  u  i> 

» 1^ 
i  I  I 


Jf  lA 

u  u 


u  u 


MM 
X  U 


% 
% 


4r  <8r 

%  % 

CM  %D  ' 

lA  lA 

%  % 


O 
% 


MCMCSIlAtMJtrMiA 
^  U"^  U*s»  U"^  u 


ID 
% 

MID 
XM 


ff>4  M 


I  I 


T»  a 
-  E 

«M«A 
I  I 


-  e 

lA 


2^2  I2I2I2I 


I  I 


ID 
I  I 


«0C'O«HlMfA,CtlA 


u  u 

21 

IDf^ 
MM 


ID 
% 

M 


U 

m 

M 


I    I    I    I    I    I    I    I    I  I 


ri 

o 


11 


o 
a 


s 


mm 


So. 


435 


I 


3 
O 

a 
o 


I 

U 

m 


Ik 


UIA 


£  «^K>£t?UUUuUUUUUUUUUUPUUUUUUUU 

'  ^    2  Sr-S*^*^  v-p-cw^x-^-p  ar  ft-o  ftp  tp  ap  ap  ax  a-pxpx 

'^^1   •••••  11  I  II  i 

M  ^«H«MrHfHr«liHrHf-4fl-4r-4ip-lF^iHF4  9-4  f>4      i-4     iH  iH      r4      ^  r4  ^          f-4  f-<  f-4  1-4  «i4  f-4  «h  «h  t- 


r4 

K 

^  lA 

CO 

t  1 

1 

1  1 

ERIC 


436 


WST  conr  available 


I 


I 


c 


a 


ft 


0. 
M 

01 


c 

i 


M 
ID 


I* 

I 

e 

e 

% 
a 


c 

ID 

c 


ft; 
a 


ID 

c 


9» 

a 


<0 


s 


o  o 

>•  O 
ID  >»  w 


«l 
C 

a 


P4      M  S  fH  M 


I 

o 


C  9 


ID  >»  . 


I       UJP       I  t 

o  (A  wee 
X a.  ax 


o 
< 

iu 

O  flit 

M  _ 


s 

13 


6 

lA  3 

>• 

X  u 

X  O 

<D  'XS 

e 

ID  >^  U 

01  — 

7. 

i 

§  III 

1  1 

1  1 

o 

u  o  e 

o  e 

4.* 

4^00  o 

X 


9IU  «  a 
oa.  &  5 


X  *< 

e  ID  >>  ^ 
z  Of  A'  JS 
< 

£  U 
O  V 

O  w     III      O  o 

u  uee e  a  a 
0)iMO>w  ^lua'o 

^  >»  > 
H  *•  I-  ** 


< 


ID  >» 


f  • 


ERIC 


437 


O 


c 
if 
c 


a 


E 
3 
C 


S 


V  JB 


o  c.  » 


U 

c 

iaT> 


O  ID  >^  I,  O 

<  < 

£  1-4  M  KH  S 

575  c  3 

_eee  u  u 
a.  a  M         j^Q.  ajo 


c 
o 
u 

M 

lA  3 

<0  >k  V  c 
< 

»H  CM  K\  £ 


(6 


o 
c 

3 
O 
>- 


J* 


C 

u 


IP-  J5 


o 
u 

^  »- 

I  4-*  Jo 


IHCN 


COO 

III     u  u  «  u 

O  O  O  ^  (A 

ClU  «l  IQ  V  O 

U  A.  o  v  a  M 

>-  > 

4^  C  4i< 


I  I 


is 

I   I      O*-*      I   I  I 

OOP  uoeeu 
uS*'  S  u  o 

J3  >-  > 


< 


l8 

U  > 

Mi  a>  o 


ss. 

«  X  4,  o 
»  «« JB  z 
< 

iH  CM  £ 


c 

III  CJ 

O  O  O  fek. 

_  Ui 

So. 


bj4 


u 

0)  *<il 
« 

1    I  I 


43 


a; 

u 

K 

c 

w 

X 

o 

a» 

c 

c 

0) 

0 

c; 

D 

Cl 

o 

> 

4J 

*^ 

3 

h 

0 

0 

X 

c 

c 

E 

in 

§ 

o 

> 

X 

3 

—  C 
C  > 

^  c 


:3 
o 


X 

C: 


X 


> 

a 

X 

o 


a: 


CO 


in 
c 

X 

o 

X  E 


X 


> 

m 

X 

o 


0; 

X 

a* 

I 

c 


3 
X 


C 
0 


u 


c 

Of 


en 

b 

5 


8 


8 


c  u 
c 

4-'  £ 


C 


c  ^ 
*j  c 


c 


(A 


C 
^* 

c 

K 

C; 

C 


c 


> 

c 


in 
C 

# 

in  X 

C  ^ 
X 

4^  X 

X  ^ 


X 


in 
c 


X 


a 
o 

c 


I/) 
■o 


<0 
"C 

<A 

b 

b 

X 
U 


b:  > 
c 

^  o 

^  > 

t  f 

c  c 

>  <c 

c  u 

£  I 


b  «. 

£  o 
u 


a  c 
b 

•w  to 

«c  > 
u 

o 

u  c 


8 

Ml 


C 

E 
cm 


cow 


« 
c 

9 


« 
U 

a 
c 


o 

«^ 

c. 


in 

I 

c 

i 

HA 

in 


u 

b 

u 
c 


in 


X 

o 

4J       <  ♦-^ 


a: 

X 


in 

X 


X 

c 

o 

X 

o 

4J  JC 

•e  I- 


c 

«> 

o  u 

U  A' 


I 

Ml 
C 

Ml  ID 

hi 

Z  o 


5 


CM 

in 

o 

1 

1 

1 

• 

1 

f-i 

• 

I  I 


I  I 


t 

c 

s 

c 
« 

c 

1 

IC 


m: 


9 

I 
I 

^ 
I 
I 


r 


e 
c 
t 
c 


c 


•5 

c 


M 
C 


b 

« 

o 
«i 
a 


4.*  « 

u  c. 

P  o 
c 

«u 

x:  "C 
•3 

o 

O  3 
>^  O 
I-  >- 

c 

3 


in 
> 

o 
> 
c 


Ml 

b 

c 


HI  tH  ^ 


0 

0 

bL 

C 

0; 

0  u 

X 

«  K 

H 

C  tt 

3 

10  >» 

i 

o- 

w  « 

e 

rl  CNI 

1 

1  • 

1 

MM 

CM 

ERIC 


439 


4 


C 

X 

e 

lA 


X 


c. 
o 

c 


Id 


c 

w 

c 

< 


I. 


b 
u 
e 


4-* 

o 

ft 
o 


•2 


o 

c 

O 


III 

C 

lb  s 

X  9  >. 
Jt  lA 


c 


< 


< 

e 
o 


OCA. 


c 

o  — 

«  < 

o 


o 
< 


c 
o 

Ui 

<  — 

r:  w 


lA  rHI  H 
O  K 


o 
z 


3 

o 


X 

T3 
lA 

in 
c 


o 
>- 

3 


CO  C  ^  i/>f-^f^<  OK 

uioic  cujcuj^fHCfowaiK 
0.  act  OifiL  fecs.M>%3CO-  aiD 


c 


>> 
o 

c 

3 

o 


3 


I  ?  1 


c 

E 
in 
c. 


o 


01 
X 


> 

in 

X 

o 


ft) 

CI 


IP 


o  ^ 


<0 

> 

CO 

cn 

X 

o 


c 
o 


lA 


in 
c 


u 

K 

c 

1 


c 


(A 

c 


C 
<0 


a 
o 
o 

CI 


XI 


3 


w 

3 


c 
o 


(0 

u 

3 
X> 
0> 

c 

IC 


E 

at 

X 


It; 
c 


> 
o 


4^ 

c 

Oi 
X 
3 

M 

X 


0  ^ 


in 

b 

X 

u 
IP 

0.- 


c 


c 

X 

u 

o; 
E 


a, 
c 


C 


> 

o 
> 
c 


u 

01 


X 

o 


b 

m  Cl 

u  o 

c  » 

—  ^ 

X  w 
4^ 

£  b 

c  u 

S  X 

>  i» 
o  ^ 

>  0) 
C  (A 

*"  X 

u  c 
c 

10  X 

X  o 
u 

0; 

E  « 


O 

X 

o 


•A 
3 
X 


lA 
Ot 
C 

S 
u 


o 
o 


X 

S  b 

b  » 

in 

O  ^ 


Ik 

c 


S 

c 


c 

I 

M 
0» 

10 
lA 


X 

o 

X 


c 

0> 

aoJ 
o  u 

0)  K 

a  o» 

(0  > 


e 

•H 

Ifl 

IP 

• 

1 

M 

• 

• 

• 

1 

M 

1 

M 

1 

CM 

1  1 

H  (A-iioe>-ttH*' 


ERIC 


440 


I 


v 


I 


e 


M 

I 
k 

e 
ft 

«•< 

C 


u 
c 

b 

u 
c 


I 

(A 
C 
O  « 

9  3 
o 

2  >» 


erJc 


lA 


a» 


• 

m 

E 

•1 

X 

c 

»■» 

%- 

o 

C 

« 

c 

o 

4^ 

p 

x; 

a 

c 

« 

c 

c 

cc 

0 

a> 

c 

c 

<c 

>^ 

4^ 

c 

a. 

S 

(6 

0^ 

0. 

9 

O 

• 

« 

3 

b 

c 

t 

no 

• 

«^ 

o 

v1 

o 

c 

a 

0 

>^ 

h 

4? 

CL 

Iff 

c 

O 

b 

u 

0 

a 

C 

3 

>^ 

0 

•o 

>^ 

«c 

o 

s 

o 

f^* 

no 

3 

>• 

cr 

c 

9 

3 

far 

in 

ID 

o 

i 

t 

1 

1 

lA 

to 

ID 

c 

X 


■D 
C 
10 

A 
O 

a 


I 

b 

M 
0 
>> 

4^ 

»  0} 

a;  3  o  o 

>^  CT  C  u 
^  1.  09  ^  C 

K>  «SMA  ID 


1  I  I  i  I 

ID  ID  ID  ID  ID 


c 


CA 

c 
o 


a 

9 
U 

u 
o 

in 


lA 


c 


i 

M 

3 

O 

C 


O  3 

c  3 
era.  a  9 


442 


a 


1^ 


I 


0 


9 
O 

3S 

9 
O 


lA 
C 


c 


(0 
01 

in 
c 
o 


4»l 

1 

1 

Of 

lA 

Cl 

b; 

9 

e 

U 

0 

U 

0 

a 

a  9 

a  9 

on  V 

CM 

m  e 

fH  0 

1 

1 

1  1 

1  1 

f-4 

IH  CS 

CM  m 

Or 
E 


IC 


0» 
10 


9 

S 


o 

O 


k 
o 

b 

0) 
X 


—  £ 


•5 

3 
c 


o 
u 


c 


0) 
u 

a 
*i 

3      ^  >  « 

O     O  V  o  o«- 

<6  I.  (D  C 
OS  UJE  3 

K>  -»  m  »o 


I  I  I  I  I 
m  m  •n  m  ^n 


I 


BEST  COPT  AVAILABli 


c 
o 


*9 

a 

9 

o 


O  ID 

10  III 

_  X3 

^  C 

k  § 

r  « 


• 

b; 
9 

O 

c 

jC 

4^ 

cr 

u 

C 

s 

X 

• 

;i 

bC 
C 

jC 

1  <A 

!  c 

o 

TJ 

C 

** 

«D 

ll 

a> 

a 

a 

0 

K 

a# 

!  « 

a 

M 

i 

«j 

b 

D. 

0 

C 

•s 

UJ 

£ 

err 

c 

^» 

10 
T3 


b 

E 

k 
c 

t 
** 
s 

o. 

E 

o 
u 


c 

c 
o 


c 
E 


4-» 
O 

—  > 


u 


c 

IP  ^ 
u 

U  IC 

o  ^ 
E 

^  D 
0) 


I 

c 


a; 
c 
c 

c 

0) 


a 
cr 


I  I 


X 


I 


o 


lA 


to 


c 


o 
a 


in 

(A 


M 


V 
l»- 

o 

c 
o 

I: 


9k* 


ID 


O 


0 

k 

o 


01 
0* 


3 
O 


C 

.10 


01 
0^ 


in 


00    o>  o 

till 


cr 

» 
a 


CI 

^•  S 
3*3  — 

g.  q-Bl 

<o  w.  c 
e>4 1*^  JT  tf\ 

l-l  rH  iH  r-l 
I    I    I  I 


ERIC 


443 


C  0 
O  liJ  V  o 


c 

1 

P 

P 

o; 

9 

O 

>- 

c 

10 

• 

«> 

a 

o 

u 

IC 

a 

c 

X 

o 

Vr 

CO 

en 

c 

0) 

c 

10 

(0 

0^ 

•c 

X 

CO 

c 

c 

c 

0 

ID 

10 

a 

u 

p 

D 

U 

o 

0^ 

C 

u 

IP 

> 

0. 

u 

IC 

lA 

0) 

X 

0 

lA 

c 

4^ 

w 

b 

b 

01 

4^ 

a 

10 

« 

u 

0) 

0 

c 

M 

CO 

X 

«-* 

0 

9» 

• 

c 

X 

« 

o 

8 

7! 

o 

<0 

o 

01 

r 

CM 

1 

1 

b 

« 

a 
o 
«» 
a 

c 
o 

u 
c 


I 

01 


o> 

a 
o 

a 
c 


X 


c 
*> 

b 

M 
lA 
> 
O 

c 

-  \ 

10  c 
u 

t 

»  c 

^  s 

> 


0) 


c 


b 


c 
o 

u 

3 
O 


I 

C 


o 


(A 
U 

10 


«l 

x: 
U 


in 
O 

c 


o 


> 
> 


tfi 

t 

c 

b 

c 
e 

(A 


b 

« 

u 

a 
o 

h 


c 

c 

O 

> 

• 

c 

lis 

o 

> 

E 

o 

1  n 

b 

X 

4S 

#** 

ft 

m 

ft 

01 

b 

c 

> 

V) 

i> 

i. 

#: 

> 

c 

b 

b 

o 

c 

MP 

K 

4J» 

c 

■V 

lu 

f 

C: 

4rf 

b 

b 

ILk 

u 

w 

V 

u 

• 

IT 

(0 

C 

c 

4-» 

^  - 

r 

c 

b 

v# 

ir 

C 
w 

c 

4^ 

u 

fell 

It 

f 

b 

• 

(A 

IB 

Wt 

in 

tJ 
w 

• 

VI 

t» 
w 

c 

c 

ft 

Hi 

> 

c 

cu 

o 

r 

u 

*in 

3 

CP 

X 

MM 

IS 

in 

XI 

& 

% 

c 

X 

c 

in 

• 

X 

7n 

b 

I  0 

u 

1^ 

f 

4i 

c 

c 

C 

c 

2 

It 

in 

IV 

E 

c 

c 

3 

in 

in 

O 

•0 

< 

ns 

c: 

CU 

c 

• 

in 

a 

> 

'J 

1 

P 

& 

o 

U 

it 

a 

u 

en 

X 

o 

u 

b 

u 

c 

o  . 

E 

g 

0 

M 

b 

in 

a 

X 

JC 

> 

o 

0) 

g 

4J 

0 

i 

a 

1 

0 

e 

o 

4^ 

a 

0 

1- 

IC 

h 

c 
in 

ID 


u 


u>  10 
•  I 


I 


U 

4^ 

c 

U 

« 

4-» 

in 

e 

0 

u 

c 

b 

■a 

0  c 

in  0 

in  0 

—  0 

in 

in  c 

in  c 

c 

«C  0  44 

0 

c 

c 

(U*^  IC 

1.  >  u 

in 

0  1.  3 

9  C 

a»  Cti 

X  > 

X  > 

1.  IT.  0^  >- 

10  >^ 

ID  > 

lC«OX 

> 

U  4^ 

U  44 

2  »  s 

CM  lA 

CD  1^  CO 

fHf-4^ 

•  1 

1  1 

•    1  • 

1 

r<4  ffH 

fH  i-l 

> 
o 

10 


in 
«^ 

b 
44 

ID 
U 

X 


03 

c 
o 


in 

IC 

a; 


u 
0^ 


o 
c 

3 

C 

CM 


O 
>^ 

b 

bC 
0) 

44 

ID 
U 


in  c 
c  _ 
o 


in 
in 


4^ 

m 

ID 


X 

o 


a: 

X 


3 


CM 


O 

U  IC 

bb 
m  > 

ic  > 


u 
19 

44 

•  c 
o 

c 

O  in  in 
tn  in 

4J  «tf 

IC  c  c 

3  in  in 
X  3  3 

6^  X  X 


c 

Tc 

ID 

> 

I. 
44 

in 

n: 


c 

I. 

b 

u 
c 


(A 


0> 


M 
«> 

b 

IC 

p 
at 

X 


0) 

c 
o 


A. 
M 
<D 


c 
o 


I. 


c  b  o 

02  c 

b  b  9 

«l  o  o 


I 


I  I 

CM  C>»l 


(C  X  XXI  >  C 
»  S  S  »  4J  9 

^  irt  to  r«.  00  A 


I  I  I  I  I  I 

N  M  CM  N  CM  C4 


ERIC 


444 


I 

1 

I 


i 


b 

** 

ft 
O 

e. 

X 


a. 

§  : 

c  b 

*•  «; 

c  le 


0! 

C  M 

-0  ^ 


c 


9 
** 

c 


o  «. 

c  e 

§  i 

>>  I* 

3  cr 


c 
e 

<p 
u 

3 
« 

o 
b 

w 

<D 
C 

a> 


a< 

jc 

o 

(D 

•c 

3 
O 

u 


0. 

> 
o 

« 


(A 


AC 

s 


c 
IP 
i> 

3 
O 


C 


u 
c 


c  • 

ox> 

•a  S 
O  6 

•HI  CM 


I  • 


c 
c 


(0 

b 

0> 


o 
b 

u 

a: 


0^ 


ID 

3 
C 

o 


c  • 

O 

^  c 
u 

^  b 

ID  > 


I  I 


b 

U 

JC 


c 

c 

c 


6:  \> 
c  c 


CA 

^  s: 


a' 


tf)  o 
c 

O  4^ 

3 

4^  C 

a  * 
3  > 

o  o 

0  ^ 

o 

V-  c 
C  £ 
U 

<c  o; 
c  *^ 

fe  - 

v. 

«;  tn 
£  0. 


^  c 

M  in 

c 

o 

^b 

in  V)  in 
O  in  M  C 

u  a>  v  (0 
^  c  c 
>.-^  t 
.  in  irt  3 
0  3  3  0 

5  »  I  *• 
(D  r«>  eo 


till 

|A  1^  1^ 


u 

U 

b 

u 
c 


in 
c 
o 


u 

I. 
•5 


o 


lA 

o 

I 

CA 
C 


o 


C  lA 

'  b 

^  tie 

o  a> 

o  '  ^ 

u 

o  c> 


in 


in 
JO 

e 


3 


I 


I 

V 

Of 


e 

4-» 

c 

3 

o 
u 
u 

A 

c 
<c 


c 
o 

16 
E 

b 

E 
c 

<c 

1^. 


lA 

> 

o 
> 
c 


b 

tL 
09 
4^ 

CD 
U 

CA 
CA 

at 
c 

JO 

I- 


1 

M 

ID 

o 

t) 

0 

CA 

X 

in 

u 

o 

b 

0 

(0 

0 

lA 

• 

no 

s 

C 

*> 

fO 

3 

b 

u 

o 

CA 

• 

ca 

b 

• 

b 

bt 

c 

01 

0> 

CO 

41 

b 

x: 

(0 

u 

u 

5 

0) 

E 

CA 

b 

c 

AC 

o 

OS 

u 

c 

u 

in 

c 

dn 

c 

0 

CA 

c 

IC 

tn 

lA 

tn 

10 

> 

c 

c 

c 

in 

*5 

> 

XL 

c 

c 

u 

% 

<c 

c. 

M 

1 

b 

>^ 

«». 

IC 

c 

«> 

b: 

1 

> 

K 

3 

o 

«D 

0 

> 

U 

c 

c 

ID 

« 

• 

x: 

b: 

c^ 

« 

o 

O 

u 

c 

c 

0 

«D 

c 

O 

u 

u 

c 

CA 

c^ 

1 

0 

• 

CA 

X 

01 

• 

CA 

CA 

b 

do 

b: 

• 

CA 

> 

in 

CA 

in 

01 

0> 

o 

10 

•R 

o 

c 

> 

u 

c 

.0 

at 

0 

> 

b 

>^ 

b 

b: 

4# 

e 

z 

3 

IB 

m 

3 


O 

b 

on 

8 


S 

X 


o 
o 

b 


c 
> 


X 


a; 
u 
c 
« 

in 


O 

b 

V 

u 

V 

X 


o 

1 

u 


o 


01 
X 


I 


4r 


•A 

lA 

CO 

Ob 

i 

1 

• 

• 

1 

• 

1 

I 


ERIC 


445 


0. 
o 


u 
c 

b 
u 
c 


c  > 

O  4J 


I  • 


in  o 

U  O  O 
c  c  c 

u  3 


in 
c 


I 


»  »  s  ^ 


III! 


0 

> 
o 

<0 


0 

b 

u 


« 
c 

c 

c 


in 
10 
0^ 


in 
c 
o 


o 

e 


9 

o 


c 

3 


I 


o 
b 


u 


c 

cn 

Ml 


1  s  I 


o 

10 


o 


0» 

> 

«) 
in 


in 

b 

u 


c 
o 


i 


0^ 


9 
9 


I 

ii% 


«  8 

u  ^ 
C 

in  > 

u 


I  I 


<p 

>% 

in 
0} 


u 

b 

u 
c 


in 


in  «A  c  m 

in  .  —  c 

ft  O  O  10 

c  o  c 

in  4^  u  9 

a  3  o>  o 
X  o  **>- 


O 

b 


«0 


a  jc 


m 

10 

0} 


m 
c 
o 

u 


c 
in 


c 

10 


U 

CD 


b 

ID 

is 
o 

It- 
CD 

C  O 


"B 

3 
O 
>- 

c 

9 


III!  I 

UMA  lA  li>  lA 


o 


9 
9 


I 

ID 


O 
C 

u 

0) 


o 


b 

Ik. 

«> 
*-» 

<0 

u 
ft 

X 


ft 

X 

o 
in 

10 
"V 

1 

u 


o 

ft  o 
u  b: 
c 

ft  > 
«n> 


I  I 

ID  10 


ft 
U 

c 

73 
in 


o 

b 

Ik 

o: 

u 
o: 

X 


ft 
X 

o 

in 
<o 

9 
O 
U 


10 
U 


le 
ic 


ft 
in 
<c 
ft 


u 
ft 

b 

u 
e 


ft 
a 


ft 

in 
10 

ft 


in 
c 
o 


u 
ft 


o 


£8 

o  tc 
c 

X  >» 

8b 


ID  >^ 
U  M 


ID  ID 


in  in  in 
in  c 
w  O  ^ 

9  9  0 
X  O* 

nx  >k 
lA  le  i*» 


I  I  I 

(0  40  <D 


c 

9 


ID 


I 


ID 
X 


AC 

c 

in  ^ 
X 


W  9 

ft  o 

o 


b 

fee 
ft 


in 

ID 
ft 

b 


c 
c 

o  ^ 


(0 
9 

u 
u 
o 


0} 


in 

Dl 

> 

ID 


o  i 


(0 
X 


8 

a: 


9 


o 
c 


in 
ft 

ft 
a 


X 

u 

10 


in 

X 

o 


ft 


in 


•  ^ 

f-  9 

^  «« 

lA  ID  M 

«X  Q  » 

u  e  i. 

<0  1.  (0  ^ 

ux  uJB 

C4      Jt  lA 

« 

I    •    I  I 


ERIC 


44G 


c 


3 

I 

P  P4( 


<6  S  £  10  * 
US  O  U  •->  I 

u  A.  ace  a.  a  u 


X 

C 

• 

IT 

c 

c 

c 

c 

X 

0.' 

c 

o 

in 

u 

in 

c 

c 

7n 

0 

3 

in 

X 

<c 

A  ■ 

c 

n> 

c 

b 

E 

u 

oo 

• 

X 

u 

ID 

c 

c 

X 

o 

u 

ID 

10 

VI 

c 

01 

Z 

c 

4^ 

nq 

c 

o 

o 

<n 

10 

6 

u 

• 

u 

a 

ii 

u 

O 

c 

«> 

U 

•D 

& 

nd 

M 

<o 

c 

C 

10 

M 

tc 

b 

lb 

no 

1 

1 

•o 

i 


2 

> 
« 

% 


<0 


I 

0) 

u 
*> 

t 


1 

• 

44 

10 

44 

c 

0 

u 

1 

• 

C 

c 

1 

0 

M 

4IS 

W 

« 

IP 

« 

<e 

c 

C 

u 

9 

"5! 

b 

1 

9 

a  a 

a  a 

a  9 

«  0- 

6>  cr 

V  er 

^  0 

•H  0 

^0 

1  1 

1  1 

1  1 

1  1 

CM  lA 

8 


I  I 


*> 

• 

0 

1 

w 

K 

0 

V 

a 

& 

«<* 

E 

^ 

3 

0 

0 

Jt 

h 

3 

0 

X 

>k 

«»• 

X 

4^ 

c 

K 

9 

1 

C 

*•» 

c 

1 

in 

1 

8 

«. 

c 

1 

%» 
c 

i 

44 

« 

X 

« 

mm**  V 

IS  «i  e 

9 

0  «  0  0 

0 

U  1.  MO 

a  9 

0  3 

^  w  A  w 

«  0- 

u  Jl 

0 

1  1 

1  1 

1  1 

1 

till 

10  r% 

•>>»ao 

ERIC 


I  0  S 


m 
o 


X 

a 


a: 


X 

E 


X 


s 


S  9 


3 
9 


w  S  MID 


u 


c 
a 


•5 


X 


X 

o 


in 

•c 
c 

10 

in 
c 
c 


Si  — 


u 
o 


o  in 


b 


a* 


0>  Ul  «  « 
i»  A.  »  k> 


c 


lii  «it      O  CM 

O  as  iHM  O  K 
2      C9  Z  ID 

<      —  <  <^ 

o  o  —         v>  u  ^ 
H  in«->i  iDO>i>tti-- 


a  IP 

Si 


1  I 


4# 

ID 

3 

5 

e 

« 

>- 

c 

% 

o 

in 

• 

c 

01 

1-4 

o 

0 

VI 

» 

9 

01 

ID 

d 

0 

3 

>^ 

ID 

m 

U 

ID 

u 

0 

« 

o 

• 

in 

01 

0 

o 

X 

in 

« 

DC 

44 

0> 

b 

3 

Im 

5 

• 

o» 

b 

X 

ID 

m 

u 

44 

*4 

M 

ID 

CO 

U 

E 

01 

0» 

0> 

X 

44 

b 

c 

ID 

0» 

•m 

E 

0 

44 

ID 

ID 

00 

3 

X 

X 

11 

4b4 

01 

ID 

ID 

X 

> 

0» 

Of 

4^ 

01 

c 

o 

o 

0 

3 

01 

o 

e 

X 

X 

3 

44 

ID 

o 

0 

4^ 

c 

ID 

ID 

b 

fH 

o 

01 

in 

O 

•HI 

in 

3 

E 

X 

ID 

ID 

in 

St 

0^ 

o 

s 

av 

a 

ID 

g 

X 

«> 

• 

c 

X 

3 

3 

*J 

0 

o 

3 

c 

in 

O 

< 

>» 

ID 

a 

M 

01 

• 

M 

m 

lA 

I 

in 

4^ 

01 

in 

4j 

01 

b 

H 

44 

01 

b 

c 

c 

CV 

fA 

i 

1 

i 

iHI 

f-4 

f-4 

81 
U 

c 

0 

c 


b 

§ 

c 

» 
e 
o 


3 


U 


t-«MU3  b 


I  I  I 
eg  C4  K\ 


ini-»f-» JS 

1 

•H  M  K\  ^  u% 

si 

k  %  %  %  % 

•A  |A  |A  >A  >^ 

M 

91 

ERIC 


448 


b 


<  c 


c 


CC  3  C 


CM 

C^  ^ 
CM  0> 
P  * 
<M  w  CM 
M    ^  U 
CM^O  V* 
U         ^  in 
^•tf*  O  3 
r4  CM  X  X 


CU 


c      TP  ^ 


iH  CM  K\  ^  m 


•    I    I  I 


<  cu 

*i  b 


c 
c 


b 

a 
o 

0^ 


U 


U 


S  0^ 

u  ^ 

N\  w  lOi 

09  ^  U 
CM  XI  I. 


r-4  CM  N%  -tf^ 


I  I 


<  O  Of 
C  3 

I    I    I       O  O  H 

-4  t-l  < 

O       C  CC 

>  c 


c  a 
o  o 

uj  a> 
o.  a 

f:5 


9 
O 

3 

o 

8 

3 
O 


U  00 

u  ^ 

«  w  ^ 


,0-0  T>  u 
in  f»  fi>  ^ 


ID 
U 

f 


C  9 

z o* 
<  c 

CM  H>  ^  lA    r  x:  o 
CO  «)^ 

I  •  I  t  £  u  **jc:  I 

I  ,M  r4  U  U  ■-« 

Alt  a.  o>«' 


lA 

R  » 

U  * 

tf>  win 

r-l  esl  XI 
I    •    I    I  I 


ERIC 


449 


CO 

^  CM 

% 

C 

o 

CM  C 

% 

u  ^ 

ID  w  O 

U 

c 

c 

u 

U  CO   ^  D 

c 

f-4     £  a; 

c 

3 

C" 

c  u>  ^  f--  £ 

u 

O 

rH  CN       •a-  kA 

3  w 

0^ 

u 
c 

u 


li-^  est 

CM  IP 


CV  "s^  o  - 

o 

est  X 


u 

lA 


u 

c 
o 
u 


ID 
c 


3 


U  I 


I    I    I    f  I 


o 

s  u 

<  c 
a;  o 
u  n  u 
c  o  u  c: 


O     ^  ^  £ 

rH  eg  K\  lA 


I  I  •  I  I 


o 
<  c 

r  p  G 

C      10  C 

OO  3  O 

U  U  JD  U  I 

lA  lA 

3  Ul  0)  3 

X  o.  ax 


3 


oo 

U  00 
^  CM 

u  ^ 
00  wee 
«^  u  ^  u 

U  00  ^  u 
«s..^O  3 
•HCMX  JD 

ax  T>     w  > 

€)  Ml      ^  JE  ^ 

CM  K%  .tf  lA  lo 
I  I  I  t  I  I  I 


IT' 

W 

X 

X 

44 

44 

• 

i  ft 

in 

10 

lA 

V 

V 

C 

3 

0 

10 

lo 

w 
W 

c 

44 

10 

w 

10 

in 

a 

c 

0 

3 

fO 

44 

U 

44 

u 

!C 

0 

c 

w 

09 

01 

X 

90 

u 

44 

» 

0 

44 

<0 

i 

mm 

c 

4* 

0 

0 

0 

Ol 

•0 

M 

4* 

0 

mm 

09 

10 

At 

u 

01 

w 

3 

III 

c 

3 

c 

0 

Aft 

U 

X. 

01 

V 

ill 

0* 

w 

01 

ms 

> 

3 

4^ 

0 

C 

•0 

3 

44 

s 

c 

»0 

c 

VI 

0 

u 

10 

3 

44 

w 

w 

h 

X 

<0 

u 

4J 

3 

44 

h 

lA 

W 

c 

!^ 

M« 

44 

3^ 

»0 

44 

w 

c 

01 

C 

w 

3 

ill 

Al 

w 

4irf 

> 

s 

mm* 

<0 

0 

c 

0<) 

X 

It 

X 

u 

c 

44 

44 

10 

K 

M 

!•» 

X 

0^ 

X 

Be 

to 

h 

ic 

k 

X 

X 

3 

m  % 

V 

X 

c 

10 

lO 

Ok 

h 

8 

c 

44 

mm 

c 

10 

0 

V 

44 

A 
V 

in 

0 

c  % 

01 

«  • 
V 

c 

c 

<0 

3 

0 

44 

fO 

10 

<0 

> 

'  a 

<0 

9 

44 

3 

0 

cn 

M 

01 

mm 

3 

U 

P 

E 

C 

3 

CM 

«^ 

1 

1 

1 

1 

CM 

CM 

CM 

CM 

ERIC 


450 


u 
o 
i> 


c 


U 

<0  »_ 


> 

c 

c 

c 
c 


(C 


O 

u 

c 


c 

i  b 


u 


^  c 


8 

X 

c 


c 
o 


b 

a; 

s 


O  (0 
3  % 


I 

u 


o 
o 

u 

M 


c 

9 

CI 

0 

> 

X 

in 

o 

> 

10 

> 

c 

o 

tr 

c 

o 

c 

It 

u 

c 

3 

X 

? 

o 

e: 

IL 

U 

X 

o; 

3 

X 

in 

•c 

c 

c 

c 

> 

X 

<A 

CI 

u 

O 

fH 

in 

m 

»v 

*  * 

«^ 

X 

c 

c 

C 

C 

t. 

C: 

)^ 

X 

Op 

X 

• 

c 

c 

IT 

o 

ft 

in 

a 

< 

c 

3 

e 

tl' 

X 

c 

c 

*55 

C 

c 

in 

Q; 

(ID 

c; 

a; 

k. 
E 

C 

C 

«^ 

3 

C^ 

c 

X 

E 

w 

Ti 

fC 

C 

in 

u 

C 

c^ 

c 

X 

5 

C 

c 

X 

c 

«0 

in 

Ik 

O 

a* 

• 

e 

Til 

X 

4ft 

in 

c 

It 

c 

> 

16 

>^ 

X 

in 

It 

no 

IC 

E 

c 

3 

> 

X 

O 

o 

4J 

CI 

>- 

X 

Q> 

c 

3 

X 

* 

yo 

3 

«^ 

no 

^» 

3 

>^ 

c 

O 

c 

> 

>^ 

c 

to 

E 

X 

X 

< 

u 

a» 

E 

X 

It 

•5 

o 

Ml 

ID 

HI 

1 

M 

1 

1 

CM 

1 

CM 

1 

CM 

1 

<v 

1 

CM 

o 
< 

CI  c 
^  u 

O  UJ 


CI 


CI 
CI 


o 
u 

3 


CI 

^  I 

o 
u 


CL  X 

c  in 

«H  CM 


U  1^ 

_  %  ^      ^    «Q  IP 

R  CI  ^  <^ 

pp.Wf^OiHCMrOJ^iAlC  CM  iH  1^  fH 

T|  ^UiHf-<tHr-#f-lFi^fHf^rHlfHX*HXf-<Xr-lX 

lA  %i-%s.^V*'^'*Ni'V.V*-^*s.^O^P5*^CM^lA 

73  lout's  73 157;  uo 

•px  u^'^'^'^^'^'^ctx  ax  ftx?  ax  ax 
io.:fii>«#r^o»«"*oHicsii^jriAor^ac^Or^w 

^«^pN«-4r-lfHiF^r»4r-4fHCMCMCM 
I    I    I    I    I    •    I    •    •    I    I    i    •    >    I    •    •    •    •  9 


% 

lA 

% 

•H  X  f" 

il*^ 

10^1" 
u  u 

ax 
B  — 

CM  f^C^ 
•  t 


o 

ERIC 


451 


lA  10 
£  X 


U 


U 

cx 


lA 
U  U  U 

-  E'- 


er 

o 
u 


I   I   I   O  O      O  I 


pi 


o     ^  % 

CM  fH  CM  CM 


<-«N>Xi*-%UUUUUUUUUOUUUU 


(SA  H\ 


CM 

CM  ^f^ 
U 

CM  ^ 

u  u 

X  a 

E 

o 


iO 
•A 

CM 

^•H 
'V*  U 
KN  ^ 
fH  to 

u  u 

CM  rA 

CM  CM 


lA 
% 

CM  lA 

id  fH 
Jt  ^ 
u  o 
-D  a 

-  E 

^  iA 
e<4  iM 


IA 

CM  to 
X  fH 

^  o 

lA-V 
fH  00 

O  P 

^  CL 

-  e 

CM 


4f 


ID 


IO 

u 


«  i  i   i   I  i   I  I  I   I  I  I 


i  I   I  I   I   I   I  I 


«o 

i  fC 

•H  U 

o 
> 


o 
z 
< 


c 
o 

Ui 
A. 


t2 


I 

u 


<0 
C 

o 


u 
o 
> 

^  cr 

10  o 
>  <D  i 


Uin  *u 
^jre  O 
f-i  K\  J5  > 


I    I    I   »  I 


ERIC 


452 


% 


C  f*^ 


CM  K% 


^       \«      ^  i.  \j  V 


i    I  I 


00  c> 

•  I 


^      ^      jj^      jjt  Ji' 

4S»  %%%%%% 

^       ^     oo  tf3     lA  •rr 

U  U  U  OX  U-^U'**«..U*^Uv^U'**«..U'*N..U*^ 
UUUUUOOUUUOUUUOUOUU 

•ris'c  ax  c-c  a-c  ax  ax  ax  ax  ax 

I   I    I    I    I    I    I    I    I    •    I    »   •    I   •    I    •    I    I  £ 


c  ^ 


O 

o 

u 


er 


lA 


4r 


U    ^  O  ~ 

M  O    ^  U  rH  r-i  fH  .;f  r-1  ^ 

ajsxx  •xxxxxxx  ax  ax 
0  ^ti^^jS'^^^'^^^'^ 


% 

00 


u  u 

ax 
6- 


I  I    I    i     I     I     I    I     I     I    I     I    I    I     t    I    1     I  I 


X  ax 


ERIC 


453 


% 

ac 

•A 

CD 

uuuucuuuuuu 

<  o 

'     ^     csj  CM  CM  rw  CM  CM  CM  CM  3:L  O 

oo  ^ 

t  •  I  I  I  I  I  •  I  I  I  CO 

^  f-l  f-H  r-li-4  fH  f««  f-H  O 

"to.  a 


3 
C 

O 

g 

a  I 

O 


o 

■g 

8 

U 
X 

Z  rA  X  tJ  O 


(A 
lA 

«^ 

CM  ID 
O  * 
w  O 


% 

% 

% 

OS 

O 

CM 

% 

% 

% 

% 

% 

rtCM  m 
I  I  I 


2iS 


CM  rA 
U  O 

u  u 


^  LA 
1-4  tH 

U  O 

u  V 


^  lA  ic 
I  •   •  • 


t3  T3 
CO  O 
I    I    I  I 


CO  ^Oinf-4iACMlAfAlA.tf-lA(AlAi04A 
f-4CP^IAf-^X«--tX«-4X<HXMXfHX«^X 

-i^fHir^CMiHrArH^a'i-liAf-^tCfHlVr^OOiH 
UUUUUUUOUUOUPOOUU 

-o  cx  ax  ax  ex  ax  ax  ax  ax  > 

p^arA^tAXrr^^oDcr^o^cMfArfiAiOf^o&^O 

r-lfHv^rHr-lrH^fHCMeMCMCMCMCMCyCMCMCMrA 
I    1     I     I     I     I     •     •     •     •     t    •     •    •     •    •     I     •  I 


454 


I  I 


MM 
I*  « 


Qb 
a. 

3 

o 


O  #  ni  i» 
o  _  o 

A 


> 

o 


or 
e 


3 
C 


1> 

Q» 
(9 


3 
3 

cr 


I  I 

ro  M 
-< 

g 

& 

o 


Qi 

3 

C 

3 

ir 

1 


Ml 


D 

i 


53 

0"T3  -POT 

e  r^c 

VI  tfl  o 

cr  o  I 
c  o 
Ml 

> 

o  ^ 

X 

M 


O  O 
I  I 


-< 
O 

c 

fib 

GL 

9 
O 


1^ 


7 

cr 

Ml 


53 

2  "O  2 

> 


4r 


I    I  • 

ifir  iP'  «• 
oo  ^  cr> 


VI 

zr 

Ml 
O 


8 

o 

■o 
o 
c 

rt 


1  1  1 

i   1  1 

t 

1  1 

1  1  1 

1 

1  • 

4C 

^  ^  ^ 

VI 

V4 

VI 

V*  V* 

VI  ^  VI 

N>  M  O 

w 

00  «^ 

^  VI  4=" 

vi 

rr  rr 

rf  rt 

rt 

rr 

<  < 

<  < 

<  < 

<  < 

< 

< 

Vi  O 

M  o 

a 

O 

c 

3r 

o 

rt 

fl 

Ml 

0 

:^ 

rt 

O 

0 

3^ 

3 

O 

0 

3 

o 

Ml 

O 

Ml 

8 

o 

(0 


3 
M 
3 

1 

or 
o 


3 


cr 
c 

Ml  M» 

rt  < 
o  — 

3  rt 
C 


ar 

9 
3 


3 
C 


9 

n 


455 


ERIC 


r»  — i 
•< 

O  A  ni  o 
oo—       — o 
II    no  I 
o  ^ 


8 


<0 


o 
c 

Qi 

a 

s 
s 

9 
3 

I 


cr 
c 

Ml 
O 

o 


C  ft  rn  C 
o  oo  O 

e  o 

> 


O  O  O 
I    I  I 


<  -< 


O 
c 

'9: 
a 

O 


3 
C 

3 

or 


u< 

cr  rt> 

^  <  Q> 

ag 


3 
O 


< 


3 
C 

3 
cr 


o  I 

a 
c 

o 

01 


HI 
<  -< 

a  ft  m  a 

O  O  C  CO 
II       <D  O  I 
GLO 
C  2 

> 


0  o 

1  I 


-< 
o 
c 

a 

a. 

O 


ft 


3 

C 

3 


o 
3. 


rr  m 

-< 

O 

c 

0» 

a 

3 
O 
rt 

rt 
< 

3 

01 

3 
C 
3 
X 


<  -< 

ft  -3  "O  rr 

o        o  o  o 

rt  O  III 

it  O 

n  3: 

3       W4  N> 

> 

O      ^  <  01 

8? 

rt  C 

a. 

3 

e 


C  <T>  C 
O  O 

c  o 


3  ' 


(tt 


3 

a» 

3 

e 

I 


-< 

3 


P 


o 


3 

9 


91 


3 

» 

3 

e 


lERLC 


It 

ft 


3 


3 

C 

3 


o 

3 


rt 
O 


o» 
(t 


3 


3 

0» 

3 
C 

i 


01 

f9 


< 

■3 


3 
01 
3 

i 


01 

tA 


< 
3 


3 
01 
3 

i 
4 


< 


3 
91 
3 

I 

=t 


•a 

rt 

•3 


3 
fi» 


rt 
O 


456 


O      m  O 


I  I 


O 

c 
a 

3 
O 


< 

o 
o 


o 
o 


o 


oo 
I  I 


-< 
o 
c 

a 

a 

3 
O 


< 


3 


> 

5 


(0 


si 


3 


01 

C 

ST 


< 

.1> 


3 

I 

1 


3 
3 

i 


erJc 


457 


I 

I 


r»i »  m  o  o  o  o 
om  o  oo  o  o 
—  >         «r  ^ 
-I  O  -«  o  vr  -P* 
K    o  o  o  o 


0300000000CDOOOOOO  O 
^  'tr  tf"  \M  \M       \M  Smt  \M  \^  y^fi  ^  \M  ^ 

K>»-*0^^'«aovJi^v/if^j)-*o  -^^co-*.^  -n»-ri 

OOOOOOOOO^OOOOOO^  3 

-3  -n  -j5 


(9  3 

:r    Ti  IP 

:r  rr  o  "H  "H  c 

3  -p  r>  -5  n 

m  a  o  50  j:^ 

m  ^     3  O  :n 

3  :o  3  ^ 

—     —  — 

HZ      2  3 
H  75  H  H 

r-  r-  X 

H  N>      «^  X 

7«>  11 

75       w  tt    tl  X  OO 

CO 

CI  w 

o  - 

o 

-  3  ^ 

^  H% 

>  H  H 

H 

H  ^ 

?^  O  - 

=  -H 

cr 

»  n 

^  \n  O0 

m  z: 

%  O 

m 

%  C 

• 

> 

o 

r- 

X  -H 


ERIC 


3 


o 


3 


vn 


3 
> 


3 
o 


3 


CO 

3 

9 


3 
"O 


3 

C 

m 
3 


> 


> 


c 


3: 

nn 
(/> 


m 


U1 

> 


2  xi^r^ai'^ddv 


3 
C 

C 

m 
o 


>  > 


-•1 
> 


?3 
H 
> 


m 
rn 


m 


3 


-3 

:^ 
»  *  .# 

V  -.-3  PI  H 

H  X  VI 
^  w  X 


o 


3  o  o  o  o 

3  oo  3  O 

r"  V*N4  o 
O  O  3  O  3 

*^  X 
^  V«  -H 

»    U  II    M  IZ 


O  O  O  o  o 

o  o  o  o  o 

^  ^  ^ 

o  o  o  o  o 
7>  3     Tj  n 

3  ^  3  73  3 
H  —  M  H 

3  3  T  3 
^  H  ro 
r>a  o 
O  -iO  - O 


o  o 
o  o 

o  o 


o  o  o 
o  o  o 

Hi*  3 
I—  O  '-^ 

o  o  o 
Tj  "n  > 

3  A 

—  :3 


O  3  O  3 
3  3  O  O 
O  O  O  O 

•»  ^  o  vjn 
0030 


o  o 


o 

O  3 
O  3 

o  o 


o  o 

>>>>>>>3 


n  3 

rn:-  3 

3 

3 

'^•^ 

0  3  'ZI 

*o 

X  /P 

C 

*H  rn 

C  H 

Tl 

m 

>  m 

;c  ^ 

> 

3 

3 

-n  — 

3:0  r> 

CZ  3 

:;3  3 

3 

Cm  P^ 

> 

> 

CI 

X  3 

3—13 

• 

r>  3 

>3m 

c5 

X  3 

p- 

3 

p. 

30 

3 

cn 

M  3 

^  rn 

.C  3 

-1 

.D  C 

rti 

rri 

3  r> 

c/:3 

X 

3 

r~  > 

3nl 

H 

Z  - 

H 

rti  — 

3 

X 

3  3 

3 

> 

• 

* 

J> 

22 

• 

> 

n 

3 

* 

> 

> 

o 


V  > 
o  rr 

fn 
2 


00 

o 


C3> 


M  II 
>  Hi-^  • 

3  3 

:S  f»  ^ 
-n 

m 


cr*  ut 

Hi>*  Vff' 

II  II  n  tl 


>  > 

ll  It 


3  H  .0 

w  .-n  c: 
-H  o  c/>  r> 
^  ^  XI 
3  2:  r  m 
3m  > 
X3  r-  ;/>  H 
t*-*  3  f>  — 

•<  o  :a: 


3  ^. 
c  -3 

—  n 
^  > 
.-n  H 
— 
V)  3 

3  - 


w  > 

II  ^ 

O 


> 

o 


< 

•n  VI 
•  o 

% 

3 
<^ 

O 


3  n 


c 
*n 


m 


> 


•-458 


ae  o  o  o  o 
900  o  o  o 
4f  iCr 
^  V  N> 
900  O  O  O 

^  -o  rt 

:9 9:9  ;o  73  m 

X 


o  o 
o  o 
^  *^ 
i-»  o 

o  o 


=  r->  2 
/)rnc/>  o 

omrn  x 
>    —  -H 

^H€A  C 
SX 

:5ni>  H 
o 

2X;5  > 

-4  5>  — 

n  3 

:SO  m 

Z7 

/I  :o  3  H 
r -^c  > 

rim o 
2  XX 

o  -«r> 
^ 

o  m 

c  -< 
nr-2 
/>  OS 

sm:r> 

-«< 
#  m 

8 

H 

m 


>  ^ 

X 

w  > 


m 


000 
000 

SiP4  \^  Vi/4 

00 
O  O  9 

■n  "tS 
O  33  m 

^  —  X 

:r  H 

O  X 


m 
c 


< 
> 


00000 
00000 

\M  \M  ^  \M 

o>  vn  ^  V« 

00000 

—  —  -n  ^  -2 
-n  ^  o  m 
>     :3  —  X 
>C  :5-l 

w>  y  • 
M  i%  0  m 

O  X  D  O 
O  H 
3      O  — 


00000 
00000 
U4  04  N)  N>  rs> 

iP-»  o  00  «^ 
00000 

^  ^  O  ^  73 

•n     ;o  :3  SI 
19     —  — 

^  C  X  -1  2 
^  H  U  -H  -H 
X  H* 
w      *H  ^ 

II    D  :^ 

9  ^  \/1 


o  o 

O  O 
O  O 


o  o 
o  o 

o  o 


00000 
00000 
N>  N>        H*  I-* 

fs*        O  CO 

00000 
^  "3 

73       !^  ;3  ^ 


000 
000 

l-i  H-i 
*a  V» 
000 

-3  13  ^ 

:^  —  "SJ 


00000 
00000 

H«  H«  O 

v<  ro  O 
00000 


X 


09 
O 


> 


< 
> 
r- 

c 
m 


o  X 
m 


-< 

c/i 

> 


< 
> 
r- 
C 
m 
w 


03 

m 


"3  •o 
SI 

m  • 

o  o 

73  m 


o  «n  — 


c 

> 
Z 

o 


3 

> 
Tl 

H 

m 


-< 


>> 


m 


sc  s  r  : 

Ti  zr  m  m  H 

wl  «2  X 

>  m  H  H  m 
j:  ?3  m  m  -< 

p-  -<  2 
m  O  D  —  X 
X  X  ;«r  c/) 

-< 

-9  r-  o  > 
X  >  o  r* 
-<  V>  X  X  c/> 
v>  -H  m  o  O 

<  <  ^  75 

>  >  >  m 


<  rn  m  >  X 
>  X  r> 
r-*  —  -n  p- 
C  1:  D  O 

m     »  v> 
v>  m     <  .T» 
->     >  ^ 
o  >  r- 
X  r>  X  r3 
X  m  •< 

3  > 
D  C  -n  -3 
C  tl  D  3 
-3  V>  C/) 
^    H  H 

—  m  3 
H  3  :>  3 
-<  X  O  -3 
*9  XX 
m  7Z  m 

>  ;/> 
«:3  X« 
;3  ^  :o  s 


^  o 

X  N» 

o 

X  % 

C  rs> 
c/>  o 


O 

it  o 
m  > 

r-  o 

X 

VI 

:3 
>  o 


H  > 

-  o 


-< 


< 


m 

m 
o 


11     -n  o  -3 

73  O  —  :?3 
X  —  --J^J  X  — 
H  X 

M  ft 
-4%  ••-^ 
^  O  — «  VI 
.D  O  O  ^ 

w  0  Vrf 

C 
> 


ooooeooo 
00000000 
00000000 

000  00000 

:3;9;3::3;3V9  79A 


H  -H  -5      H      •H  H  -4 


:9  : 
m  -3 
X 

m  m 
X  t/> 
■35  C/> 

m 

;3  :;o 


o  X 

o  X 
o 

H  X  D 
X  m  3 
—  32 
VI  - 

m  = 
>  o 


m  -<  H 
X  3  -< 
>  X  -3 

X  m 
■o  X 
r-  c  — 

m  X 
o     3  X  m 

n 

o  •  r>  r- 
C  o 

•3  >  -3  •'^  3 

>  — > 

-H  --1  O 
-  r3  —  H  X 
3  m  3  X  -3 

0:  4.1  X  Tl  > 
C/>      X  H 


m  :> 
:3  Tl 

:n  m 

< 

m 

-<  o 

X 

m 

2  m 

H  X 

<  TO 
-< 


X 

X 
3 


;3 

3 

> 


siiiits:  3 

-4  t^l 


3  -< 
3 
>  X 

3  X 

y%  > 
H  < 
:o  m 

3 

^  a 

X 

m  o 
— 
•  3 


m 

c/i 


3 


ERIC 


459 


BEST  COPT  AVMLABU 


o  o 
o  e 


oooo< 

99  VX» 


rn  3 


o  o  o  o 
o  c»  o  o 

00  00  00  00 

^  C>  vn  4r 
o  o  o  o 

^  7>  ^  7> 
^  ^  ^  ^ 


r^q^^i  Qo-iooHoo7^7« 


o  o  o  e> 
o  o  o  o 
09  00  oo  eo 

NJ  ^  O 

o  o  o  o 

'll  5 

-3  ^  ^  — 


o  o  o 
o  o  o 

*4 

00 

o  o  o 


o 


-n  D  m 

>  9  K 


o  o 
o  o 
^  •a 

0  o 

—  H 

1  o 


H  D  5> 


< 

m  -19  m 
n 


I-  m  v» 
>  *ti  is> 

mm  % 

X  O 
H  3  > 

25  2 

m  > 
HX 
SO  D 

J  > 
e  o 


o 
c 
9 


> 


X 

> 


c 
9 


rri 
X 


> 

m 
> 
-I 


^-«  H«  ^  4^  u  M 


H  O  7^ 

X  -'^ 


00  2 
oo 

O  VI 
O 


OM 

m 


-< 


s: 

m 


3 

O 


M  > 


> 


> 


-< 


3> 
Tl 

O 
3 


;5 
c 

9 


9 
3 


s: 
> 


X 
> 

z 


oooouoooo 

300003000 

r2  o  "1 
-H  ^  7^  ^  -H  -H 

^  ^  w  ^  II  7^ 

O  H  O  K  «^  *  O 
C      X  H  ^3  M 

?3      rri  X      w  O  O 


m     vn  ^ 

n  .  o 

X 


o 
o 


o 
o 


D 
H 

O 


H 


ftl 
> 


-< 


> 
ftl 


> 

z 


o 


> 


H 
•< 


Z 

c 


pn 
9 


9 


c 
9 


> 


m 

CO 


X 

> 
z 


o  o  o 
o  o  o 
o  CT  vn 

i-i  o 

o  o  o 

-uo  — 
»  tl 

—  HO 
a:  o-^ 

•H  Cl  /5 
-< 

D  H 
C  X 
9  rn 

S  cn 

;ti  w4 

—  o 
r> 

X 


9 


O  9  O 
O  O  O 

vn  ui  vn 
so  7> 
o  o  o 

—  -p.  ^ 

T|  *r  :;3i 
:3  ^  — 
^  X  i 
7X  H 

V 

M  ^ 

O  7^ 


o  o 
o  o 
vn  vr 

o  o 


z 


OOOOO  O  O  O  -D  - 

ooooooooo 
•   \r»  vn      j:*      ^  ^     .  - 

o  o  ^  o  o  o  o  o  3  r. 

^  Tl'^'^t)": 


m 

9 


X 

> 
z 


-< 


> 

z 
s 

:^ 
m 

TO 


79 


> 
tl 


-< 


> 

Z 

m 
9 


9 
o 


«       V       q»       V       ^      —  — 

-T|  C  r-  >  rr 
X  c/>mcn  :j 
rn  >  m  H  VI ;  I 

v>  -o  z  :r 

r*  c:  o  i: 
55  m  3  — ' 

m  ••     C3  £ 

H  9n-n  X 

C  > 

-2     r»     >  o-nx 

m  M  H  : 

H  z>  o  >  >-HCAc: 

X      Z    2  ;9  Z  X  VI 

m     r-  •<     Tl  >  -4 

Z     —  s  o 

X  rr 

m     m  o  —  •n 

o    c/i  -r>;j? 

-H    01  -2X  ^ 

>  -4  v>  t:  01 

•n  -in- 

m  z-h:s 

I—  -  > 
m  ^  ^  =  ^ 

O  m  H  O 

-•  z  2  .tl 
^  -11  rn  r>  ^ 

>  H*  o  X 
^  OH, 

ox-^ 

?i- 

t/>— 
-«< 


X 


ERIC 


4G0 


I 

i 


|S2SSS?SS2S32SSSS22S22SS2SSSS2SS^ 


cn  qivn  VI  ut  ui  VI  vn 
 ^  e»  ^  m  VI  ^ 


VI  VI 

o  o 

—  :^ 
c  c 


Vt  W> 

o  o 


^  n  ^ 

3  O  O 


3     S  S  2  -H  H 

O  ^ 
ji       •      •  —  Ui 

3  5 


:q  rn  O 
—  x-4 


CI 

o 

?3 


or  ^ 

VI  XT 
O  O 


4r4r«*V4ViVlV.^V^V^ 


-n-g  —  »>-ox 


o 

:3 


O 


H  rr  D 


O 
> 


H 


O 

c 
;9 


> 
< 

> 

CO 


> 
< 

> 

C9 


%  n     —  II  — 

H«U1%  VM  — •  O 

H  H  C  ^       w  D  Ml 

XX'*'-'  12  VI 


V*  ls> 

o  o 

—  H 
-<  O 


< 
O 

> 

C3 


VI 


N>  NJ  N»  N>  N> 

C9  %4  O  VI  4r 
o  o  o  o  o 

 ^ 

33  D  -n 
—  -H  -ti  ^ 

O  s 
-Hip-  — —  H 

^  o 

C       H»  Vl% 

-J     H  H  C 
X  S  ^ 
Tt     rri  m 

>  2  :s 

< 

3       VI  N> 

>  o  o 


O  O 


o 
o 


o 

o  o  o  o 


> 


Orti 
.;ix 


C_  H  ^  H  1^-4^ 


II 


It  .p. 


VI  *^  v^s  ■ 

o  o  u  •  > 


—  1^ 

m 


O  3 

3  :r 


> 
< 
o 

> 

:3 


< 

> 


VI 


X 


> 


> 
-I 


> 


rsi 


> 


> 

2 


> 


2 
> 


3 


> 


n  ;3 
v>  > 


X 


> 


-< 
m 


2 


m 


> 
m 


;9 

3 


15 


::3 
H 

VI 


> 
m 


-< 

■a 

m 


c  > 

3  "a: 
m  c 


9 

rri 


53 
3 


m 
> 


-< 

-9 


> 


X  ^ 


n 
> 

•n 

H 
-< 


C  > 


3» 
3 


VI 


Vt 


O 

VI 


VI 


vt 


461 


900000000 


I  \n  ^  Wi  N» 


^  — —  — ^  — ^  — 

•  Z -< -O  S  SO  -3 
:  •(/>    ■<  -n  ^  o 

nix  OH 

•  zm  «»c:  -< 
:  1^  z    -<  -o 


O  m  z: 

HI  m 

H  £ 
H  O 

*<  S 

•no  rm 

m  X  — 

>  7% 

«X  X 

Xn  H 


o  o  o  o  o  o 

N>  IS3  N>  M  N>  N> 
1^  O  O  O  9  O 

o  '-^  w  *«a  o  v» 
o  o  o  eo  9 

^  —  —  -9  -3 

;p  -n  Ti     :o  » 

—  ^  -a  — 

:r        c  .-2 

H  U   II  H  H  H 

m  m 

•  s  -<  C9  : 

•H  ;D  rri  v%  — 

-OH  -  ^ 

rri  X  H  -< 

m  X  :^ 
H    rn  c 

rn  H«  rs>  £ 

X  o  o  c 
c:     O  r- 

m  r- 

;p  — 

ri 

<A  H 

—  D 

H  > 


< 
> 


o  o 
o  o 


■a  -o 

:3  :x3 


o  o  o  o 

K>  K»  ts>  li^ 

o  o  o  ^ 
ro  H*  o 
o  o  o  o 

^  no  -o  -3 
:9  ;o  9  ;3 


ooooooooooooooooooooooooooooo 


00 

II 


o  o 

-< 
II 


HHHHHHHHH 
#  »  » 


U1  45*  »^ 

o  o  o 
?p  73  ra 
433 


N>  O 

o  o  o 

H  T> 

VI  —  — 
♦  -t 
DHH 


C9  CO 
CO 
O  3 

X  r:i 
rfi  II 
X  :9 


II  ;i  II  ^  u  o  u  »  3  m  -rj  -n  D     »  '-^P  {5 

♦  ♦  ♦  ^  H 

-n  -n     —  h    h  ^ 

^        U  —  II 


—  H  H  H  H 


H      — H  — 


O 

o 


3 
> 


9 
H 


s 


3 


3 

rj 
> 

X 
3 
H 

m 


X 
H 

> 

;9 


h4 


-< 


X  9 

5  X 

H  H  rn 

X 
<  >  3 
OH-n 

o  r>  3 

>  O  G 
-0 

r>  >  c/n 
X  H  r> 

>  —  D 
X  D  ;9 
s>  X  m 
m 

w>  — 
o  -<  v> 

;/>  o 
31  X  " 


■n  H  .a 


X 


-< 
■o 
m 


-< 


X 
3 


t>4 

X 


£  -<  :n 
m  2  2> 

3 

X  S'H 


rsi 


X 
3 


< 


59 


H 

-< 
> 


•< 

3 


3 


3 


-< 

3 


:3 
> 


3 


I  CO  K« 


>  3 

'J^  3 


3 


3 
% 
% 

X 

tn 
;9 


%  H 

3  X 


•no 


> 


m 

H 

C 
> 


3 


462 


I 


o  o  e  o  o  o  o 

N>  ISA  rs>  N»  rs>  ^^  ^3 
•ni  a>  ui  ^  ^>  H* 
ooo  o  o  o  o 

m  o        —  — 

a  o  ^9  ^  :o 

o  -J    ^  2 5 

M  O  -<  ni  •  S 

o     m  ^  "3  % 
-I  f />  3  ^  :2 


o  o  o  o 

N»  N>  IS>  N> 

ro  H*  1-^  M 
O  O  O  O 

5 

—  "P 


\J%  4sr  \M 
OOO 

^  ^  — 

»  73  -3 
—  —  -D 

ir  rr  c 


-3  — 

—  "P 

:r  c: 


o  o 

o 
o  ^ 

o  o 


o  o 
o  o 

O  O 


N>  ^u  -.1 

3  O  O 

o  •T 
ooo 


^  tt  II  -i-i -4-1  H  H  <H  II 


O  fs» 
O 


•P 


X 
m 


< 


> 


--r  -<  -p 

H  O  -n 
•< 

■o  H  • 

rn  X  H 

m  X 

s  ni 
X  N»  :2 

— I  vn  N> 
X  o  o 
m  o 

< 
> 


X 

> 
X 

o 


o 

o 

> 


m  -< 
o 

-< 


X 

r>  n 


-< 


X  ^ 

Dm 


> 
< 

> 

T9 


-<  - 

nfl  X 


'3  • 


•< 


m 


-4 1:: 

-.1 

a:  o 
c 

m 

n 


-< 


o  cr 
o  r- 


X 


< 
> 


3 

t5 


H 
-4 


-13 


> 


-< 


•^4 


:9 
m 

;3 


> 

X 

m 


m 

I 


5 


■9 


ERIC 


463 


e 

:  a.  s 


AFPSNDIX  S 
TERMINAL  USAGS  PROGRAM 


e 


S       t  s  s 
csr    r  c  K 

u  s  c  ^  => 

«» 

>        —  o: 

•  er 

c  c  • 

Ik  u; 

fir  H 

u:  C:  K 

Cp*  .J  c:  ^ 

<  0.  c  c  < 
0.  ;  s  K 

•<  C 

IT 

to  <    r  1.^ 

^  X  UJ  iO  — 

^  r.  c 

<  — 

lij  r"  —  5L 

r 

—  X 

ec        —  cc 

C 

s    —  c 

c  •  c: 

5^  <  w  ^        rf  <£  £ 


c  — 


u         >  IS         C         X  ^  ? 


>-    5>-i-.t'.  i.-c^  tec  <il  S<.      nCi  wsu: 

^^.icP'P-  c-  5-^  <ro.  er    =c     w  c  5, 

-^-H  .-i'-j.  cv-t  ^.^1  EcP  «^>-  , 

-       m       c-  m  ^  u:  ^  C-OrVC  X       ...      ^  rff»-^  • 

H-         -                   _-      Irrj^  -                  t  ■  >-  ll '  f-  HCr  C      u.      r~         ^  *—  i-' 

»-i.>-  -^-^-t-ujz:  he.  rr  E"  rr  ^  siL  v  <  s      r    k    u-  k 

ru.  C-C-I--C-5  i^^J  ^c^^  ulv  H    H    Hu.    *rc  < 

e:     w  <  Z. 


fc    w      —       ^  _  <f  C2  —  <#I      sens  r-«A.»  5^ 


.r   fc  .rExxc  Sc>  =  ccx5x   ou.u     5;^  w 

0000000 oooooeocoococ 00 «oooooc«eoooooooooo 
§§g§§§§gS§SggSgggSSg§gg§So§?g§Soooooooooeooo  

464 


c 


c 


tr. 


I-./ 

t*:  ~  u- 

u:  c  r. 
s>< 

c  "5: 

ei  ,  -J 
u.  £ 

C  5  IK 

cc  — 
>-  c 
Hce  ec 

C  Ml 

^  z: 

H- 

C  — 

SL  SL 


< 


I/) 


< 

cr 
=> 
c 


c: 


1^  CJ 


c 

CD 


rt  Mi  c  .  C 


^  o 


f-4  9: 
c 


Z  rA  < 


t 


ERIC 


^  »  ^     o»  ^  s 

.  cac  :^     s:  « — 


. oeeooooo 

.  ^  -         CM  K>  ^  lAtC 

:  r .     oo  o  o  o  o 
D  o  e  o  o  o  o 


<  < 

c  oc z. 

>*u:  CO 


465 


lA  gH 

tf\  e 


IPtOO 
o  >>  » 


BEST  con  AVAILABLE 


APPENDIX  T 
ANECDOTAL  INP0BMAT3DN 


•  t 


o 

V 
CQ 

O 

o 

> 
O 

o 

U 

I 


H  O  U  ^ 

O  U  B  0  .c 
to  d  4->  o  o  (Q 


o 

Q  « 


f 

V 


;>  IQ  C  •H  ^ 

g  r-l  ^  0> 

X  s  ^  § 
u  ^  ^  x:  n 

O  bp  >>  u 
_  C  B  S 

Ill  I 

U  Q>  o  m 

U  B 

Cm  4>»  -P  (0 
H  (m  CO  4>  ^ 
CO  g) 

._  O  S 

5» 


Cm 

E  . 

O  0^  CO 
to 

•H  V4  ^ 

>  <M  O 


H 


fO 
•H 

O 

u 

a  c 
CO  at 

OS 


c& 


P 


ll 

n 


^      as  a)  0) 

0)  fi8    »  . 


4* 

^2 


4^  %  iH  H  '2   •    ptiH  O  C 

§ 0«M-P'H4^<w»f;  CO 


8 

O  O 
C  §  £  'S  S 

o  S     i4  i 

•H  H       ^  4* 

a>  CO  4>  o 

^  :s  >  S  ^ 
c  a>  6  o 

u  4>      ^  4> 

.S  ^1^5  S  g  g 


I 


erJc 


46/ 


i 


•C  Q  I 
•  P3  SSI 


O  H 


0) 


IQ  w 
(0 


I 


CO  CO 

^  a>  c: 

10  «  &  -rj 

o  o     ^  o 

4)  H  rj  <M 
g  CO  c  6 

o  4^  CD  a> 

O  P   «5   fr«  4* 

o  o>  o 
3  >  c? 
^  CO  13      Q«  • 


CO  CO      K  S 
0«  H 

§C9 

CO  to  f;,  g  4>  iH 


€  cd  V4  1 


O  to  C> 

4>  *i  •H| 

CO  CO  IQ  B 
to  ♦H  •H 

_  Cm  CO  CO  _B 

o  p  «  Jg  2 

Q    b  <  <  < 


'1 


d  CO  CO  4i  i 
^       -H  CO 

S  u 

^4  to  ^ 
Cm  to  ^ 


1 


I    I    Q)  I 


(0  -H  «0 

u  to 

CO  o# 

to  o  ^  o 

^£  a  „ 

CO  e 

to      4>  to 


Pi 
V 
Xi 

% 

4-> 

» 

g 

to 


•1 

tol 


8\ 


CO  •H 

to  C 


to 


«w  to 


to 
to 


CQ 

to 


a> 


ERIC 


to 

O 

§ 
c 
o 
p 

g 

o 

CO 
CO 


•a 
2 

Cm 

4; 


to 


1? 

OS 


to 


o 


468 


o 


o 


CO 
4^ 
CO 

I 


o 
4> 


o 


(0 

I 

o  I  o  I  o 

<«b  1%  I'M* 


T3 

0   I  10 


8 


I. 

to 

OI 


to 


^1 


o 


o 
p 

Cm 
O 


ERIC 


I 


•H  X  Oil  e  1 


9  4»  Tl  -Hi  (0 


C  0) 


ho  .  , 
Q>  e>  6 

K  c  y  -hIh  o  •O 


rd»  ^  •  ^1  &  ^3  0) 

*    to  §1  o  a  5  o 

1  iS  *^ 

Sri  o 

H  to    •hI'O  3  g 


tfN 


eu^      8  8  •  • 

c  0     •H  a>  1^  CD 

^  »d  *S  CO  &  H 
u'O.soqpiOv 

"8        S  S  »  fep-i 


0 


1 
g 

8. 


469 


s 

8 

CM 
I 


I 

I 


CO 
u 

Si 
o 
CO 

I 


O 


cvj 


CO 

•H  42  'S 

o  c  c; 
c  a>  a> 

t  i  i 


u  5  I. 


4^ 

CO 

a> 
> 


H 


?3 


rv) 


s 


(0 


cONO  -ho:: 


0 


s 

S 

s 

1^ 


g 
I 

a 

o 

K 

Cm 
D 


o 
u 


§• 

8. 

Cm 
O 


o 

•a 


5 


CO 

er 


e 

•H 

CO 

§ 


ERIC 


CO 

I 

2 

O 
P 
•H 

C8 


o 


no 


18 

CO 
0 


o 


o 
% 


9 

1 


APPENDIX  U 


laCTERNAL  EVALUATION  REPORT 


471 


eOUCATIOMAL  SEavlCES  AND  PRODUCTS*  IlC« 
Sill  Colony  Woods  Driva 
KalaaatoOy  MlehlgAii  49C09 


Inter in  Evaluation  Roport  t 
Oetobor*  1973 


HUMAN  AND  CCIITUTER  ASSISTED  GUIDANCE  PROGRAM 
The  School  District  of  the  City  of  Pontiac*  Michigan 


Subnitted  Byt 

Theodore  L.  Ploughman,  Ph.D» 
Evaluation  Consultant 


472 

ERIC 


Interim  Evaluation  Report  t 


Oct.  1973 


Project:  Hunnan  and  Computer  Assisted  Guidance  (CAST)  Progran 
Agency:   The  school  District  ot  the  City  of  Pontiac»  Michigan 

EVALUATION  REPORT 

Eyaluat  ion  ^Contract 

The  contract  for  external  evaluation  services  was  let  to  Educational 
Services  and  Products,  Inc.  for  the  period  beginning  July  1,  1973  through 
June  30»  1974.    Evaluation  services  will  be  provided  principally  by 
Theodore  L.  Ploughman,  Ph.D..    Services  and/or  materials  to  be  provided  are 
as  follows: 

(1)  Review  student  skill  objectives  by  grade  level. 

(2)  Review  and  critique  evaluation  design. 

(3)  Recommend  evaluation  design  changes.  If  necessary. 

(4)  Review,  critique  and  assist  In  developing  all  evaluation 
Instruments  and  data  analysis  procedures. 

(5)  Monitor  evaluation  activities. 

The  evaluation  effort  Is  structured  to  Include  n  high  level  of  cooper- 
at  Ion  between  the  CAST  Program  Director,  the  Pont  lac  Schools  R&D  Department, 
and  the  external  evaluator.    A  minimum  of  twelve  (12)  on-site  consultations 
between  these  three  participants  are  scheduled. 

This  report  covers  the  period  between  July  I,  1973  throuRh  October  30, 
19  - i.  Four  U')  slte-vlslts  were  made  by  the  external  evaluation  consultant 
during  this  period. 
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Major  consultant  services  during  tho  period  covered  by  this  report 
were  directed  towards  the  development  oC  the  Phase  III  plan*  speciCically 
the  Methods  and  Evaluation  section*    The  Plan  progressed  from  an  early 
conceptual  design  to  the  pbulished  document  dated  July,  1973* 

Six  Project  Level  Objec'clves  were  formalised  to  Include  the  essential 
elements:    (1)    Objective  statement,  (2)    Method(s)  tc  reach  the  objective* 
C3)    Method(s)  to  evaluate  the  objectives,  and  (4)  !>ata  analysis  design. 

These  six  Project  Level  Objectives  and  their  evaluation  design  are. 
the  focus  for  evaluation  discussions  between  the  Project  Director,  R&D 
staff,  and  the  external  evaluator.    Each  site  visit  addresses  each  of  the 
objectives  in  terms  of  progress  of  the  evaluation  effort* 

Prosress 

Each  of  the  sire  Project  Level  Objectives  will  bo  reviewed  according 
to  discussions  and  actions  prior  to  October  1,  1973. 

£*:i«ctl.vejOne  -  ONE  HUNDRED  TWE.^TY  FIVE  ELEMENTARY,  700  JUNIOR  HIGH 
AND  200  HIGH  SCHOOL  STUDENTS  WILL  DEMONSTRATE  KNOWLEDGE  0?  CAREER 
ACHIEVlMCNT  skills  NECESSARY  FOR  CAREER  PLACEMENT  DURING  THE 
1973-74  SCHOOL  YEAR. 

A*    Methods  used  to  Reach  the  Objective     (Comjiljpted jcoj^^ 

!•  Select  30-40  elementary  and  secondary  participants  for  the 
1973*74  school  year. 

2*  Train  73-74  trainees  and  retrain  72-73  participants  In  the 
Human,  Educational,  and  Career  skills  necessary  to  deliver 
the  CAST  prosra.'a* 

fii££\iSi§.LSiil  '    Coverall  student  learning  object !*/es  are  skill  and 
understanding  In:    (1)  Expanding  Jobs,  (2)  Deelslon*maklng,  and  (3) 
Career  planning*    The  evaluation  effort  must  Include  an  assessment  of 
those  culminating  objectives  at  the  end  of  the  Phase  III  pexbd*  An 
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example  of  evidence  of  skill  and  under stanrlttg  would  be  one  student  teach* 
Ing  another  how  to  make  a  career  choice  decision.    The  question  raised 
with  respect  to  this  particular  example  was  «  Must  the  program  then  In* 
elude  teaching  students  how  to  teach?    Further  discussion  of  this  evalua- 
tlon  component  is  required* 

Teachers  arc  scoring  all  student  tests.    Pont  lac  R&D  staff  will  compile^ 
analyse,  and  report  results.    Assistance  will  be  provided  by  the  extemnl 
evaluator.    Concern  for  a  proper  test  protocal  for  teacher  administration 
of  tests  has  been  addressed  by  providing  guidelines  to  the  teachers*  The 
external  evaluator  anticipates  making  observations  of  test  administration* 

The  "Career  Achlevcnent  Skills  Training  -  Teachers  Manual"  will  be 
updated  or  revised  during  Phase  III.    No  evaluation  critique  is  anticipated 
for  the  Manual*    Concern  was  expressed  that  some  critique  was  necessary  to 
inform  review  agencies  o£  strengths  and  weaknesses  discovered  during  t:se* 

Subjective  judgements  will  be  made  of  item  worth  for  student  test  items* 
Item  scores  will  be  correlated  with  overall  performance  ratings*    R&D  will 
attempt  to  create  an  instriinent  to  test  level  of  performance  on  a  culmlna* 
Cing  "total"  skill.    This  Instrument  to  measure  goal  achievement  will  be 
treated  as  an  independent  variable  for  conparlsons  with  individual  perfor* 
nance  objective  test  results  treated  as  dependent  variables* 

Oyectlvejrwo  -  THi:  1973-74  TRAirCES  WILL  DEMCNSTRAVE  KNCJLEDGE  OF 
INTERPJRSOI^AL  SKILLS,  EDUCATIONAL  SKILLS  AND  CAREER  SKILLS  r^ECESSARY 
TO  DELIVER  THE  CAST  P?.CX;R.*mM  DURING  TH£  1973-74  SCHOOL  YEAR. 

A*    Methods  used  to  Reach  the  Objective  (C«ir£lettd^tojdotG) 
t*    Select  25-30  1973-74  trainees. 

2,    Train  73-74  trainees  in  Human,  Educational  and  Career  Skills 
necessary  to  deliver  the  Cast  program* 

3*    Establish  CAST  goals  for  trainees* 
giseussioii  -  The  pro-test  of  teachers  entering  the  training  workshops 
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vas  biased  to  some  tmknown  degree  by  exposure  to  workshop  materials  prior 
to  testing*   An  alternative  **pre*test**  was  eonsidered*   The  selection  of 
teachers  as  trainees  included  responses  by  teachers  to  an  instrunent  very 
sinllar  to  the  pre-test*    Use  of  the  selection  instrument  for  pre*post 
comparisons  is  being  considered* 

The  teacher  trainee  pre*post  test  data  permits  a  correlation  study  be* 
tveen   training  performance  and  classroom  teaching  performance*    No  formal 
analysis  and  subsequent  Project  report  is  anticipated*    The  results  of 
this  analysis,  if  made,  will  serve  for  internal  Project  response* 

The  external  evaluator  encouraged  the  Project  Director  and  R&D  staff 
to  formulate  Research  Objectives  consistent  with  the  several  unique  processes 
being  developed  within  the  project* 

fi^tStLveJThroe  -  THE  1972-73  TRAINEES  WILL  DE140NSTRATE  KNOWLEDGE  OP 
EDUCATIONAL  SKILLS  USED  FOR  DELIVERY  OP  THE  MODEL  LESSON  PLAN  FORMATS 
TO  STUDENTS  DURING  THE  SCHOOL  YEAR* 

fiL&S^S.L^'d  "       discussion  to  report 

2ki^^&LYS^S.U£  "    THREE  ELE>ffiNTARY  COUNSELORS,  ONE  JUNIOR  HIGH  COUNSELOR, 
aN£  JUNIOR  HIGH  TEACilER,  TUO  SENIOR  HIGH  COUNSELORS  AND  TWO  SENIOR  HIGH 
ADMINISTRATORS  WILL  CONDUCT  TRAINING  AND  FOLLOW-UP  SESSIONS  IN  INTER^ 
PERSONAL  SKILLS,  EDUCATIONAL  SKILLS  AND  CAREER  SKILLS  TO  NEW  CAST  PARTI^ 
CXPANTS  DURING  THE  SmiER  AND  THE  1973-74  SCHOOL  YEAR* 

A*    Methods  used  to  Reach  the  Objective  (&££ELS,i'&lJL<2..4lliZ) 

1*   Train  local  trainerr  using  representatives  from  Cftrkhuff  Assoc* 
2*    Establish  training  goals  for  trainers* 
3*   Evaluate  all  training  delivery* 

2^cus8ion  -  Diseunsion  raised  the  potential  value  of  correlating  Trainer 
levol  of  ftmctioning  tflth  Trainee  performance*    Further  consideration  of  such 
an  analysis  is  anticipated* 
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Ygg •   No  dlseussion  to  report  at  this  tlna* 


Summaf  Y ,  CoaMnen  t  a 

The  contrActual  Arrangeoents  establishing  essentially  an  evaluation 
task  force  composed  of  Project  Director*  Local  R&D  Report 8»  jind  an  external 
evaluator  pronises  both  a  comprehensive  and  meaningful  evaluation  effort. 
Local  staff  maintain  that  close  relationship  vhlch  enhances  understanding 
and  clarity  of  purpose*  The  external  evaluator  assures  objectivity*  The 
arrangement  itself  will  be  worthy  of  evaluation  at  the  termination  of  the 
Project* 
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EDUCATIONAL  SERVICES  AND  PRODUCTS*  INC. 
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Intortn  Evaluation  Raport  2 
Pebmary*  1976 


HUMAN  AND  COMPUTER  ASSISTED  GUIDANCE  PROGRAM 
Tha  School  District  of  tha  City  of  Ponttac.  Michigan 


Subnittad  Byt 

Theodore  L.  Ploughman*  Ph.D* 
Evaluation  Consultant 
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Int^rln  Evaluation  R«per€  2 


Fab.  1974 


Projaec:  Kubmhi  and  Conputar  Aaatatad  Guldanea  (CAST)  Progran 
Agancyt   Tha  School  Oiacrtct  of  tha  City  of  Pontiae,  Michigan 

EVALUATION  REPORT 

evaluation  aarvicaa  providad  by  Thaodora  L*  Plougbnan,  Ph*D*» 
of  Educational  Sarvlces  and  Produeta,  Inc.  ara  ralatad  to  tha  following 
araass 

(1)  Raview  student  skill  object ivaa  by  grade  level* 

(2)  Review  and  critique  evaluation  design* 

(3)  Reeoranend  evaluation  design  ehangeat  ^f  necessary* 

(4)  Raview,  critique  and  assist  in  developing  all  evaluation 
Instrunents  and  data  analyais  procedures* 

(5)  Monitor  evaluation  activities* 

Inter  lig  ^Report  Per  I  od 

This  report  covers  the  period  between  November  !»  1973  through 
February  19,  1974*  Three  (3)  site  visits  were  made  by  the  external 
evaluator  during  this  period. 

Inter in  Report  1  reviewed  the  status  of  each  of  the  six  Project 
Level  Objectives  as  of  October  1,  1973*    This  report  reviews  their 
status  as  of  February  19,  1974.    Only  those  steps  receiving  action 
between  October  I,  1973  and  February  19,  1974  will  be  discussed*  The 
Methods  used  to  reach  the  Objectives  presented  below  ara  either  com- 
pleted or  in  process* 
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Obioctlve  Otw  -  OSE  HUNDRED  TWENTY  FIVE  EtEMEKTARY,  700  JUNIOR  HIGH 
AND  200  HIGH  SCHOOL  STUDENTS  UILL  DEMONSTRATE  KNOWLEDGE  OF  CAREER 
ACHIEVE^NT  SKILLS  NECESSARY  FOR  CAREER  PLACEMENT  DURING  THE 
1973-74  SCHOOL  YEAR. 

A*   Methods  u8«d  to  reach  Che  Objective* 

U  Select  30*40  eleoentary  and  sec;/ndary  partlelpartt  for  the 
1973-74  school  year.  9 

2.  Train  73-74  trainees  and  retrain  72-73  participants  In  the 
Huoian,  Educational,  and  Career  skills  necessary  to  deliver 
the  CAST  program. 

3.  Followup  delivery  of  CAST  model  lesson  plans. 

4.  Evaluate  nodel  lesson  plan  development  at  the  elementary* 
Junior  high  and  senior  high  levels. 

5.  Determine  appropriate  career-curriculum  Integration  activi- 
ties. 

6.  Secure  reactions  to  CAST  program  from  students,  parents  and 
administrators. 

7.  Evaluate  student  achievement  of  Career  Achievement  Skills. 


Discussion 

Method  3  -  Each  trainer  has  from  one  to  three  trainees  to  obsetA-e. 
Using  the  teacher  Observational  Checklist  the  trainers  are  observing  an 
average  of  two  trainees  per  week. as  they  deliver  CAST  lesson  plans. 

The  Project  Director  has  developed  a  new  "Teaching  Skills  Diagnostic 
Checklist*'  for  teacher  observation.    R&D  staff  are  developing  an  evalua- 
tion design  for  analysis  of  checklist  responses. 

The  trainers  are  staff  members  who  were  In  the  CAST  program  last 
year  and  who  received  training  as  CAST  trainers  during  Summer,  1973  In- 
service  and  are  attending  an  on-going  evening  class  under  the  auspices  of 
Wayne  State  University.    This  class  meets  once  per  week,  with  an  Agenda 
prepared  by  the  Project  Director,  Judy  Battenschlag.    The  external  evalua- 
tor  attended  on  abrevlated  session  (due  to  weather  conditions).  Clear 
evidence  was  present  of  participant  Involvement  and  dedication  to  their 
CAST  training. 
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Htthod  4  •  Th»  •lenentary  and  Junior  high  lesson  plsns  are  prasentty 
balng  re-vriccen  by  a  Cask  group  coaposed  of  CAST  tralnars.    A  checklist 
of  content  attributes  similar  to  the  "Teaching  Skills  Diagnostic  Checklist*! 
Is  serving  as  a  basis  for  content  review.    Subjective  feedback  from  Lesson 
Plan  (Teacher  MsniMl)  users  and  expert  review  forms  the  evaluation  base 
leading  to  revision* 

Method  5  -  Project  staff  are  making  Judgements  as  to  which  Career 
Skills  can  be  effectively  integrated  Into  the  typical  school  subject  areas. 
Integration  plans  will  be  Included  as  supplementary  activities  to  the  CAST 
Lesson  Plans,    They  will  be  appended  to  the  elementary  and  Junior  high 
curriculum  guide. 

Method  6  -  The  Project  Director  end  the  R&D  consultant  are  In  the 
process  of  creating  a  survey  form  for  parents  and  one  for  students  to  ob- 
tain their  feedback  In  response  to  the  CAST  program.    The  Intention  to 
obtain  administrator  feedback  la  presently  not  active.    The  parent  sur» 
vey  will  be  Included  with  other  Pontlac  School  project  surveys. 

Method  7  -  Individual  student  achievement  In  the  CAST  program  is  an 
on-going  process  as  the  students  master  Instructional  modules.  The 
Project  Director  has  permitted  the  teachers  to  reduce  testing  to  assure 
completion  of  the  Lesson  Plana.    The  goal  Is  to  complete  the  total  program 
by  the  second  week  of  April* 

Currently  In  process  is  the  development  of  a  post-test  evaluation 
Instrument  to  be  administered  to  students  for  final  evaluation  of  program 
Impact.    The  Instrument  will  sample  v.trlous  skills  at  the  expanding  and 
decision-making  levels.    The  complex  skills  taught  In  CAST  do  not  lend 
themselved  easily  to  typical  paper   and  pencil  tests.    Much  effort  has 
been  expended  Individually  and  collectively  by  the  Project  Director, 
staff  R6J)  consultants,  and  the  external  evaluation  consultant  to  formalise 
an  acceptable  evaluation  design  and  Instrument. 

First  attempts  to  assess  CAST  program  Impact  by  tape  recorded  student 
responses  to  a  set  of  career-oriented  questions  was  not  successful. 
Negligible  differences  In  responses  between  control  end  experimental  pro- 
gram students  were  detected.    A  critique  of  the  Interview  Ivems  raised 
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thtt  possibility  that  they  did  not  properly  discrlnliuite  CAST  objectives 
at  •  learning  level  sufficient  to  detect  program  Impact.    The  external 
evaluation  consultant  Interpreted  the  questions  as  essentially  single 
concept  questions  which  reasonably  bright  and  articulate  students  could 
favorably  respond  to.    Another  attempt  Is  warranted  with  questions 
which  require  Integration  of  principles  snd  multl-dlmenslonal  decision- 
making* 

The  Project  Director  and  staff  R&D  consultants  are  in  the  process 
of  determining  if  interviews  with  participating  students  would  be  an 
appropriate  means  to  gather  additional  data  of  student  Impact,    Data  of 
Interest  Includes  student  perceptions  of  CAST  program  value  and  the 
presence  of  additional  learnings  not  expected  or  detected  by  papa^r  and 
pencil  tests* 

£y.«ctlve.Two  -  THE  1973-7A  TRAINEES  WILL  DEMONSTRATE  KNOWLEDGE  OF 
INTERPERSONAL  SKILLS.  EDUCATIOHAL  SKILLS  AND  CAREER  SKILLS  NECESSARY 
TO  DELIVER  THE  CAST  PROGRAM  DURING  THE  1973-74  SCHOOL  YEAR. 
A.    Methods  used  to  reach  the  Objectives 
U    Select  25-30  1973-74  trainees* 

2*    Train  73-74  trainees  In  Human,  Educational  and  Career  Skills 
necessary  to  deliver  the  CAST  program. 

3.    Establish  CAST  goals  for  trainees* 

4«    Observe  and  foLlowup  trainees. 

5.    Develop  elementary,  Junior  high  and  high  school  model 
lesson  plans* 

6*    Evaluate  model  lesson  plan  development  at  the  elementary. 
Junior  and  senior  high  levels* 

7.  Evaluate  model  lesson  plan  delivery  ot  the  elementary.  Junior 
high  and  senior  high  levels. 

8.  Determine  career-curriculum  Integration  activities. 

9.  Conduct  additional  training,  if  necessary. 
10.    Coordinate  internships. 

Dl^scusslon 

Methods  4^8  -  These  methods  are  similar  to  or  are  contained  In  the 
Methods  3-5,  Objective  0n3.      Discussion  of  these  Methods  follows  Objec- 
tlve  One. 
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Method  9  -  Training  has  contlmied.    It  Is  In  Its  final  phase. 

Method  10  -  Sonie  teachers  have  had  students  serving  Internships 
In  local  career  related  settings*    Internships  were  not  highly  active 
during  this  report  period* 

All  pre*tests  given  to  trainees  have  been  scored.    I*ost*test  scor* 
Ing  Is  not  finished.    Not  all  trainees  vere  post-tested  Immediately 
after  training* 

Pontlac  R6eD  staff  anticipate  observing  both  CAST  trained  and  not 
trained  teachers  to  determine  If  observation  will  detect  the  presence 
of  skills  addressed  In  training  at  a  higher  level  for  trained  teachers* 
The  question  of  observer  bias  because  of  knowledge  about  which  teachers 
have  been  trained  Is  recognised^    Some  attempt  may  be  made  to  secure  an 
unbiased  observer,  yet  one  trained  In  the  skills  of  the  CAST  program* 

fikiecUveJThree  -  THE  1972-73  TRAINEES  WILL  DEMONSTRATE  KNOWLEDGE  OF 
ZUUCATION'AL  SKILLS  USED  FOR  DELIVERY  OF  THE  MODEL  LESSON  PLAM  FORIIATS 
TO  STUI/E.NTS  DURING  THE  SCHOCL  YEAR. 

A  few  teachers  (1972-73  trainees)  are  serving  in  a  program  support 
role*    None  of  these  1972-73  trainees  are  really  delivering  the  program* 
A  primary  task  for  them  is  refered  to  in  Method  7*    They  are  active  in  the 
effort  to  integrate  CAST  into  subject  matter  areas*    Thay  will  also  assist 
in  the  coordination  of  internships* 

These  several  teachers  and  one  counselor  are  regular  full-time 
employees  in  their  schools*    Their  project  related  duties  are  assumed 
over  and  above  regular  school  assignments*    Ten  trainers  also  serve 
over  end  above  their  regular  school  assignments. 

£^lietLv2  j;oiir  -  TWO  ELEMENTARY  COUNSELORS,  THREE  JUNIOR  HIGH 
COUNSEU-iiS,  CNE  JUNIOR  HIGH  TEACHER,  T'.'O  SENIOR  HIGH  COUNSELORS, 
,\HD  T.^0  ADMlNlSTKAfORS  WILL  CONDUCT  TPJVINING  AI^D  FOLLCW-UP 
SESSIONS  IN  INTiiilPERSONAL  SKILLS,  EDUCATIONAJ   SKILLS  AND  CAREER 
SKILLS  XC  NEW  CAST  PARTICIPANTS  DURING  THE  SUMMER  AND  THE  1973- 
lU  SCHOCL  YEAR* 
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A»    Methods  used  Co  reach  the  objective 

K    Train  durlns  August  local  trainers  using  representatives 
from  Carkhuf f  Associates. 

2.  Establish  training  goals  for  trainers* 

3.  Evaluate  all  training  delivery. by  these  trainees  to  the 
1973-74  trainees* 

4.  Evaluate  trainer  observations  and  followup  of  participant 
delivery  of  CAST  program. 

5.  Coordinate  model  lesson  plan  development  at  elementary. 
Junior  high,  and  high  school  level* 

6.  Conduct  feedback  sessions  concerning  training,  delivery 
and  model  lesson  plan  development,  and  career-curriculum 
Integration  activities. 

Method  3  -  The  trainers  are  evaluated  on  the  same  scale  they  use  to 
evaluate  new  trainees.    The  trainers  also  respond  to  needs  that  arise  dur- 
ing the  weekly  class  meeting  for  trainers  and  trainees. 

Method  ^  -  The  Project  Director  Is  using  observational  data  as  one 
basis  for  re-wrlctlng  the  CAST  curriculum. 

Methods  5-6  -  Those  activities  were  addressed  earlier.  Friday 
morning  ireetJngs  each  week  with  staff  address  the  review  of  lesson  plan 
development  and  currlculu-n  Integration  activities. 

£kltCtlYq.?lvt  -  TH?  COMPUTER  WILL  BE  USED  TO  ANALYZE  CAREER 
ACHIEVEMENT  SKILLS  TEST  RESULTS  DURING  THE  73-76  SCHOOL  Y2AR. 

The  computer  Is  not  being  used  presently  to  rnalyze  CAST  test  data. 

Cb|ectlve_Slx  -  SECONDARY  CAST  STUDENTS  DURING  THE  73-74  SCHOOL 
YEAR  WILlTse  A  CCMPI;Tl.<  ASSISTED  CCCUl'ATIONvU  SD\PCH  SYSTEM  BASED 
ON  DR.  JOHN  HOLLAND'S  "SELF^'DIRLCTED  SEARCH  . 

Dl^scussl^on 

The  Computer  Assisted  Occupational  Search  (CACS)  system  Is  In  the 
process  of  being  ravlsed.    Additions  Include  new  «ctivltles  and  competency 
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items*    The  Job  bank  is  being  changed,  as  is  the  presence  of  Job 
sexism.    The  computer  will  be  used  to  analyze  paper  and  pencil  generated 
input  from  students.    A  small  number  of  students  will  test  the  new 
system. 

The  next  reporting  period  will  focus  upon  the  essential  data 
collections  and  analyses  conforming  to  the  Methods  and  Design  descriptions 
in  the  Phase  III  Plan  for  each  Objective, 

A  visitation  calendar  will  be  established  congruent  with  evaluation 
design  milestones.    Cooperation  has  existed  and  Is  expected  to  continue 
with  local  R&D  staff  to  fulfill  our  mutual  project  obligations* 
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L'OUCATIONAL  SERVICES  AND  PRODUCTS,  INC. 
Sill  Colony  ^oods  Drive 
Kalamasoo,  Michigan  49009 


final  Evaluation  Report 
June  1974 


HUMAN  ANJ  COMPUTER  ASSISTED  GUIDANCE  PROGRAM 
The  School  District  of  the  City  of  Pontlac,  Michigan 


Submitted  by: 

Theodore  L.  Ploughman*  Ph.D* 
Evaluation  Consultant 
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Final  evaluation  Report 
Phase  III 


June  1974 


Project:  Human  and  Computer  Assisted  Guidance  (CAST)  Program 
Aeency:    The  school  Jlstrlct  of  the  City  of  Pontlac,  Michigan 


U VALUATION  REPORT 

Jvaluation  services  provided  by  Theodore  L.  Ploughman,  Ph.D., 
of  ::duci»tlonal  Services  and  Products,  Inc.,  were  related  to  the 
following  areas: 

(1)  Hevlew  student  skill  o-»Jectlves  by  grade  level. 

(2)  Kevlew  and  critique  evaluation  design. 

C3)    .;ecommend  evaluation  design  changes,  if  necessary. 

(a)    .<evlew,  critique  and  esslst  In  developing  all  evalua- 
tion Instrunents  and  data  analysis  procedures. 

(5)    :.onltor  evaluation  activities. 

Final  tval^uat.l,on_,;)e£ljgy^ 

A  final  evaluation  design  was  developed  cooperatively  by  the 
Iroject  Director  -  Judy  battenschlag,  Pont  lac  Schools  R6iO  Specialist  - 
Al  >«vllsh,  and  external  Evaluator  -  Ted  Ploughman.    The  basic  objec- 
tive for  the  design  was  to  Include  evaluation  elements  which  service 
each  of  the  Objectives  specified  in  the  Phase  III  Plan,  dated  July,  IV 
The  evaluation  report  by  Pont  lac  Schools         Staff  relates  to  the 
Collowln;»  design. 
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***** 

EvaiuaCton  Plan  -  CAST  Project 


I.    Curriculum  Module  Tests  •  Junior  High 

CAST  Objective  1 

Analysis:     4  -  7th       ae»  2  -  8th  Grade,  I  -  9th  Grade  Class 

(1)  For  each  curriculum  module  test  compare  average  class- 
room and  grade  level  performance  with  a  Level  3 
minimum  criterion* 

(2)  Report  percentage  of  students  by  classroom  and  g^ode 
level  satisfying  the  Level  3  minimum  performance. 


II,    Student  i»ummary  Question  -  Post  Test  of  Pupil  Performance 

CAST  Objective  I 

Analysis;    7  -  Junior  High  CAST  Classes,  3  •  Control 

Compare  Experimental  students  for  the  7th,  8th,  and 
9th  grades  with  a  Control  classroom  at  oach  grade 
with  respect  to  percentage  satisfying  Level  3  minimum 
performance* 


III.    Observation  of  CAST  Trained  Ctesrooffl  Teachers  (Trainees) 
by  CAST  Teacher  Trainers 

CAST  Objective  2 

Analysis:    7  -  Junior  High  CAST  Classroom  Teachers 

The  Teacher  Observational  Checklist  was  used  by  trainers 
to  record  level  of  functioning  of  CAST  trainees* 
Compare  Trainee  level  of  functioning  by  skill  area  or 
average,  using  Level  3  as  mlnfmum  acceptable  performance* 
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IV.    Student  Performanco  vs.  Teacher  Behavior 

CAST  Objectives  I  and  2 

Analysis;    7  -  Junior  High  CAST  Classrooms 

Correlate  student  perforoance  on  aunimsry  question 
with  teacher  (trainee)  observation  scores* 


V.    Jrowth  Pre  to  Post  of  CAST  Teacher  (Trainee)  Behavior 

CAST  Objective  2 

Analysis: 

(1)  Compare  scores  of  teachers  on  selection  Instrument 
with  their  scores  on  similar  instrument  after  traln- 
ine. 

(2)  Correlate  selection  instrument  scores  (paper/pencil) 
with  teacher  Observational  Checklist  scores. 


VI,    Trainer  Level  of  Functioning 

CAST  Objective  6 

Aralysls: 

Project  Director  review  of  Trainee  observation  data 
and  performance  ratings  of  Trainers  to  make  Judgement 
"Do  better  trainers  produce  better  trainees?" 


V!I.    CAST  Student  v^uest  ionnalre 


Analysis: 

(1)  Report  item  by  item  response  summaries  -  raw  and 
average  scores. 

(2)  Make  cross  item  comparisons  as  appropriate  for  inter* 

pretat ion* 
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VIII*    Parent  Questionnaire 


Analysis: 

Report  responses  of  a  randoo  sample  of  parents 
to  the  CAST  program. 


Administrator  Questionnaire 


Analysis:      :^ot  dlstributord 


CAST  Curriculum 

Analysis:    Project  Director  and  St^tf 

(1)  Use  feedback  from  Trainers  and  Trainees  to  modify 
poit^ons  of  the  CAST  Curriculum. 

(2)  Subnlt  a  revised  "3*'  week  curriculum: 

•  Carly  elementary 
^  Upper  Elementary 

•  Junior  High  Crocus  of  effort) 


rA.    Computer  Use  •  9th  Grade 

CAST  Objective  6 

Analysis: 

Compare  performance  of  students  trained  to  make  a  Job 
search  with tbe  aid  of  a  computer  program  versus  stu» 
dents  using  a  hand  version* 
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Elementary  CAST  SCudents 


Analysis:    Grades  I  and  2 

(1)  Report  performance  of  students  on  Curriculum  Module 
quest  Ions* 

(2)  Report  discussions  by  students  of  their  goals  and 
objectives  for  careers. 

***** 
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INVOICE 


EDUCATIONAL  SERVICES  \ND  PRODUCTS^  INC, 
91 tl  Colony  Woods  Drtv9 
Kulapuieoo,  Michigan  49009 


TOt    CAST  Project  Date J    June  24,  1074 

-  Pont  lac  Public  Schools 
1830  W«  Sqiiare  Lake  Road 
Pont lac,  Michigan  48033 

Attnt    Judy  Battenschlag 
Project  Director 


Item  Description  Coat 


Contract  Amount  -  $2400.00 
Amount  paid  to  date  •  $1260.00 
lOX  Hold  for  Final  Payment  -  $240.00 
Balance  this  Invoice  •  $900*00 


external  Bvaluator  Services:     ^Jarch  7,  1974  -  June  24,  1974 

Five  slte-vlslt  days  at  $100  per  day  •  $500.00 

Five  plannlr^g  and  development  days 

at  $100.00  per  day    -  500.00 

Total  $1000.00 
Less  10%  hold  tor  Final  100.00 


Total  due  $900.00 


Submitted  by: 

Theodore  L.  Ploughman 
evaluation  Consultant 
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CONSULTING  OVERVIEW 

The  primary  components  of  the  consulting  delivery  made  by  Carkhuff 
Associates,  Inc.  to  the  Career  Achievement  Skills  Training  Program  (CAST) 
Pontiac,  Michigan  are  grouped  under  the  categories  of  People,  Programs,  and 
Organizations.    The  People  category  includes  those  components  which  relate 
specifically  tc  the  upgrading  of  skills  of  the  people  making  the  skills  delivery 
as  well  as  those  supporting  that  delivery.    Program  components  include  those 
dimensions  relating  to  the  career  skills  program  delivered  by  the  teachers  and 
counselors  and  to  the  students.    Organizational  components  are  those  which  admini- 
stratively support  and  facilitate  the  delivery  of  programd  to  the  students. 
People 

The  principle  role  played  by  the  consultants  was  to  upgrade  the  level  of 
skills  of  the  local  trainers  in  the  CAST  Program.    It  was  the  responsibility 
of  these  trainers  to  train  the  helpers,  support  the  program  delivery  made  to 
the  students,  conduct  diagnoses  of  the  ef ■ ectiveness  of  that  delivery  and  to 
prescribe  the  remediating  procedures.    To  achieve  this,  the  consultants  provi- 
ded advanced  training  in  the  discrimination  and  communication  of  career  delivery 
skills,  interpersonal  skills  and  physical  functionality  skills.    These  included 
the  following: 

1.  Content  Development  Skills;    The  ability  to  discriminate  and  opera- 
tionally define  and  break  down  subject  matter  into  functional  units. 

2.  Teaching  Methodology  Skills:    The  ability  to  discriminate  and  generate 
a  wide  variety  of  didactic,  modeling  and  experiential  methods  for 
delivering  subject  matter. 

3.  Teaching  Strategy  Skills:    The  ability  to  discriminate  and  organize 
subject  matter  presentations  so  as  to  elicit  the  congnitive  functions 
associated  with  exploring,  understanding  and  acting  on  the  learning 
materials. 
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4*      Intellectual  Responding  Skills:    The  ability  to  formulate  and  dis- 
criminate levels  of  verbal  responses  .«nlch  are  interchangeable  with 
and  appropriately  additive  to  the  intellectual  content  expressed  by 
the  student. 

5.  Classroom  Management  Skills:    The  ability  to  discriminate  and  organize 
the  physical  learning  environment  so  as  to  optimize  the  conditions  for 
learning  and  mastering  skills  as  well  as  differentially  reinforcing  the 
skill  learnings  to  insure  their  application  and  retention. 

6.  Lesson  Presentation  Skills;    The  ability  to  discriminate  and  develop 
a  lesson  so  that  it  contains  the  elements  of  readiness »  delivery » 
mastery  and  retention. 

The  consultants  conducted  classroom  observations  of  the  trainees  alone  and 
in  combination  with  the  trainers  and  master  trainer.    Systematic  classroom  obser- 
vat ion  and  diagnostic  procedures  were  developed.    Trainers  were  subsequently 
trained  in  formulating  descriptive  procedures  for  their  own  trainees.  These 
consisted  of  a  sequence  of  steps  to  be  followed  in  remediating  a  trainee  in 
each  aspect  of  the  observed  delivery.    For  example^  if  a  subject  was  identified 
to  be  functioning  at  the  conceptual  level  of  responding »  the  first  steps  would 
include  practice  In  formulating  responses  which  point  to  the  purposes  of  princi-* 
pies  of  the  skill  being  learned. 
Programs 

Consultant  input  to  the  programs  being  delivered  in  the  CAST  Program  con- 
sisted primarily  of  the  continued  expansion  of  the  program  components  and  the 
range  in  variety  of  methodology  which  could  be  utilized  to  dellvc:r  the  career 
achievement  skills.    Additional  program  training  was  provided  in  the  affiliated 
manag€;ment  techniques  and  procedures  which  would  facilitate  the  program  delivery. 
Late  in  the  program,  some  explorations  were  conducted  relative  to  the  identifica- 
E^C^  and  development  of  a  wider  range  of  teaching  strategies. 


Throughout  the  last  year  of  the  program  there  was  a  growing  concern 
for  the  development  of  transferable  strategies  for  the  skills  involved  in 
the  CAST  Program.    While  this  was  not  considered  a  main  thrust  of  the  program » 
exploration  of  transfer  potential  was  deemed  Important  to  support  the  skill 
learnings.    For  example »  career  expanding  skills  were  found  to  have  application 
in  generating  word  patterns  in  language  arts  and  in  testing  permutations  in 
mathematics.    Similarly,  career  decision-making  and  career  planning  skills  were 
found  to  have  numerous  implications  for  teaching  and  learning  in  other  curricula 
areas . 

Organizations 

Consultant  Input  was  provided  to  the  project  administration  on  an  increasing 
scale  during  the  last  year  of  the  program.    Initially^  it  was  important  to  confirm 
the  administrator's  own  delivery  skills  within  the  context  of  career  skills  as 
well  as  being  able  to  conduct  helper  training.    The  administrator  was  then  pro- 
vided systematic  procedures  for  the  implementation  of  daily  operations  in  the 
management  of  long-term  planning  operations.    Concurrent  with  this  input,  an 
internship  was  conducted  with  the  assistance  of  the  consultant  in  the  areas  of 
program  development  and  modification. 

Throughout  the  project,  the  consultants  assisted  and  supervised  in  the 
delivery  of  skills  to  the  trainers  and  the  trainees.    Additional  assistance  was 
provided  to  the  project  administrator  in  formulating  research  strategies,  conduc- 
ting final  trainer  and  trainee  assessments,  and  in  quantifying  and  qualifying  the 
results  of  the  program* 
Recommendations 

The  following  recommendations  are  made  with  the  assumption  of  program  con- 
tinuation or  application. 

1.      Trainees  should  be  selected  within  schools  in  teams  of  at  least  two 
per  grade  level  in  the  elementary  school  and  two  per  academic  subject 
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area  in  the  secondary  school.    This  will  provide  appropriate  sup- 
port and  will  facilitate  prograia  development  and  skill  transfer « 

2.  Training  should  be  conducted  In  clearly  defined  phases  interfaced 
with  supervised  classroom  skills  application.    That  is»  after  a  basic 
training  in  career  achievement  skills  and  content  responsiveness* 

the  trainees  shoulil  first  be  helped  to  systematically  implement  these 
skills  in  the  classroom.    Initially*  only  content  and  interpersonal 
skills  should  be  discriminated.    Subsequently*  methods*  strategies* 
classroom  management*  reinforcement  and  le^^son  presentation  skills 
should  be  provided  and  followed-up  one  at  a  time  to  Insure  their  imple- 
mentation and  mastery. 

3.  Trainers  should  be  individually  interned  by  a  master  trainer  for  at 
least  five  trainer-trainee  observation  sessions.    This  will  help  Insure 
accurate  discriminations  of  trainees  and  improve  the  effectiveness  of 
the  teacher  prescriptions  they  make. 

4.  Trainers*  as  with  the  trainees*  should  be  allowed  to  Implement  their 
responsibilities  in  a  systeuatic  step-by-step  program.    That  is*  to 
discriminate  and  prescribe  in  one  area  at  a  time  before  proceeding  to 
total  functioning. 

5.  Trainee  supervision  should  occur  in  at  least  25%  of  the  total  delivery 
time. 

6.  Periodic  meetings  should  be  conducted  among  those  trainers  and  trainees 
who  are  curriculum  development  oriented  and  among  those  that  are  delivery 
oriented.    This  will  facilitate  programatic  improvement  in  the  program 
and  its  delivery. 

7.  Trainers  should  be  provided  an  adjusted  class  and  counseling  load  to 
accomodate  for  their  additi^i^L^upervisory  and  :rainer  responsibilities. 

ERJC   8.      A  full  time  skills  training  team,  responsible  to  Pontiac^a  Admlnlstra-^ 


tive  Management  Team,  might  be  formed  composed  of  one  project  deve- 
loped master  trainer  and  three  trainers  (one  at  each  school  level). 
The  training  team  could  coordinate  the  efforts  of  each  school's 
training  representatives,  and  work  through  central  and  local  admini- 
strators, to  individualize  the  program  to  each  setting's  unique  needs. 
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